00000100:00100000:2.0F:1789050172.631832:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050172.631938:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0F:1789050172.632034:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691603456 00000100:00100000:1.0:1789050172.632049:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691603456 00000100:00100000:1.0:1789050172.632135:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 18 00000100:00100000:1.0:1789050172.632144:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+8:2347:x1875954691603456:12345-192.168.206.1@tcp:16:kworker.0 00000100:00100000:1.0:1789050172.632294:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+8:2347:x1875954691603456:12345-192.168.206.1@tcp:16:kworker.0 Request processed in 150us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050172.632301:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 18 00000100:00100000:3.0F:1789050172.634440:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691603328 00000100:00100000:3.0:1789050172.634456:0:15091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691603328 00002000:00100000:3.0:1789050172.634500:0:15091:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff95073c19c700 x1875954691603328/t0(0) o4->66ca7618-37f8-428a-932b-a194d1b4ace8@192.168.206.1@tcp:673/0 lens 504/0 e 0 to 0 dl 1789050183 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789050172.634512:0:15091:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff95073c19c700 with x1875954691603328 ext(0->8) 00002000:00010000:3.0:1789050172.634518:0:15091:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95073c19c700 00000100:00100000:3.0:1789050172.634558:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:3.0:1789050172.634568:0:15091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+8:2347:x1875954691603328:12345-192.168.206.1@tcp:4:bash.0 00000100:00100000:3.0:1789050172.634983:0:15091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+10:2347:x1875954691603328:12345-192.168.206.1@tcp:4:bash.0 Request processed in 406us (3150us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1789050172.634991:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 0 00002000:00100000:3.0:1789050172.634999:0:15091:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff95073c19c700 x1875954691603328/t8589934598(0) o4->66ca7618-37f8-428a-932b-a194d1b4ace8@192.168.206.1@tcp:673/0 lens 504/448 e 0 to 0 dl 1789050183 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789050172.635007:0:15091:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff95073c19c700 with x1875954691603328 ext(0->8) 00002000:00010000:3.0:1789050172.635011:0:15091:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95073c19c700 00010000:00010000:0.0F:1789050173.326595:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789050173.628756:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:2.0:1789050173.628778:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:2.0:1789050173.628795:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:1.0:1789050174.123429:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000001:00080000:1.0:1789050174.123454:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000001:00080000:1.0:1789050174.123465:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00080000:1.0:1789050174.123474:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff950704ed10c0 refcount 2 committed 0 result 0 batchid 4294967535 00000020:00080000:1.0:1789050174.123479:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff950703286f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff950704ed1240 00000020:00080000:1.0:1789050174.123482:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff950703286200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95073c5f8c00 00000020:00080000:3.0:1789050174.123500:0:14439:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967535 committed batchid 8 00000020:00080000:3.0:1789050174.123662:0:14439:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1789050174.352764:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050174.604079:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789050174.604101:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cd6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704160384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050174.604101:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cd6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704160256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050174.604238:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f42e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704160768:0@lo:400:kworker.0 00000100:00100000:1.0:1789050174.611754:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050174.611832:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f42f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875954704160896:0@lo:400:kworker.0 00000100:00100000:1.0:1789050174.611865:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050174.611886:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789050174.611892:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f42c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3284:1875954704160512:0@lo:400:kworker.0 00000100:00100000:1.0:1789050174.611917:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050174.611940:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f42f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875954704161024:0@lo:400:kworker.0 00000100:00100000:1.0:1789050174.611977:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050174.612274:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704160896 00000100:00100000:1.0:1789050174.612282:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704160896 00000100:00100000:1.0:1789050174.612320:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704161024 00000100:00100000:1.0:1789050174.612323:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704161024 00000100:00100000:1.0:1789050174.612351:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789050174.612366:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875954704160896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050174.612418:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875954704160896:12345-0@lo:400:kworker.0 Request processed in 53us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050174.612425:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789050174.612441:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789050174.612447:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875954704161024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050174.613163:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875954704161024:12345-0@lo:400:kworker.0 Request processed in 713us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050174.613171:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1789050174.613217:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050174.613248:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f42f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875954704161024:0@lo:400:kworker.0 00000100:00100000:1.0:1789050174.613261:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f42f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875954704160896:0@lo:400:kworker.0 00000100:00100000:3.0:1789050174.613663:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050174.613703:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789050174.613711:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f42f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704160640:0@lo:400:kworker.0 00000100:00100000:3.0:1789050174.613734:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050174.613754:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875954704161152:0@lo:400:kworker.0 00000100:00100000:3.0:1789050174.613774:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050174.613799:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704160768 00000100:00100000:3.0:1789050174.613804:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704160768 00000100:00100000:3.0:1789050174.613845:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704160640 00000100:00100000:3.0:1789050174.613849:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704160640 00000100:00100000:3.0:1789050174.613889:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789050174.613897:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704160768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050174.613935:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704160768:12345-0@lo:400:kworker.0 Request processed in 39us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050174.613941:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789050174.613955:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789050174.613961:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c270a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704160640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050174.614002:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c270a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704160640:12345-0@lo:400:kworker.0 Request processed in 41us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050174.614007:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789050174.614024:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704161152 00000100:00100000:3.0:1789050174.614028:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704161152 00000100:00100000:3.0:1789050174.614051:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789050174.614057:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875954704161152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050174.614084:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875954704161152:12345-0@lo:400:kworker.0 Request processed in 28us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050174.614089:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1789050174.614103:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789050174.614106:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789050174.614108:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050174.614132:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f42f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704160640:0@lo:400:kworker.0 00000100:00100000:3.0:1789050174.614141:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875954704161152:0@lo:400:kworker.0 00000100:00100000:3.0:1789050174.614149:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1789050174.614153:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95073cd6fb80, transno 8589934595 00000004:00080000:3.0:1789050174.614170:0:3283:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1789050174.614187:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f42e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704160768:0@lo:400:kworker.0 00000100:00100000:0.0:1789050174.614906:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704160384 00000100:00100000:0.0:1789050174.614914:0:15090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704160384 00000100:00100000:0.0:1789050174.614955:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789050174.614975:0:15090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704160384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789050174.615001:0:15090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789050174.615049:0:15090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704160384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (3301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050174.615055:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789050174.615454:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704160512 00000100:00100000:0.0:1789050174.615459:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704160512 00000100:00100000:0.0:1789050174.615489:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789050174.615495:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f1fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3284:x1875954704160512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050174.615530:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f1fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3284:x1875954704160512:12345-0@lo:400:kworker.0 Request processed in 35us (3611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050174.615536:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789050174.615933:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f42c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3284:1875954704160512:0@lo:400:kworker.0 00000100:00100000:0.0:1789050174.615951:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cd6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704160384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050174.616002:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050174.617677:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704160256 00000100:00100000:2.0:1789050174.617691:0:15090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704160256 00000100:00100000:2.0:1789050174.617742:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789050174.617751:0:15090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704160256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789050174.617783:0:15090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789050174.617851:0:15090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704160256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050174.617858:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789050174.617920:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cd6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704160256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050174.925113:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050174.926071:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691603584 00000100:00100000:1.0:1789050174.926083:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691603584 00000100:00100000:2.0:1789050174.926923:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 63 00000100:00100000:2.0:1789050174.926933:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+11:14396:x1875954691603584:12345-192.168.206.1@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789050174.927052:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+11:14396:x1875954691603584:12345-192.168.206.1@tcp:60:lhsmtool_posix.0 Request processed in 120us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050174.927060:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 63 00000100:00080000:3.0:1789050174.927495:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050174.932057:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050174.932164:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691603840 00000100:00100000:0.0:1789050174.932306:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691603840 00000100:00100000:0.0:1789050174.932369:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 16 00000100:00100000:0.0:1789050174.932380:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507101b2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+11:14396:x1875954691603840:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789050174.933181:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507101b2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66ca7618-37f8-428a-932b-a194d1b4ace8+12:14396:x1875954691603840:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 Request processed in 790us (1120us total) trans 8589934638 rc 0/0 00000100:00100000:0.0:1789050174.933239:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 16 00010000:00010000:2.0:1789050175.371484:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050176.206644:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050176.206689:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050176.206763:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691603968 00000100:00100000:1.0:1789050176.206772:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691603968 00000100:00100000:1.0:1789050176.206826:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 125 00000100:00100000:1.0:1789050176.206836:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f1fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:2350:x1875954691603968:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789050176.206905:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f1fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:2350:x1875954691603968:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 70us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050176.206912:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 125 00000100:00100000:3.0:1789050176.207466:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691604096 00000100:00100000:3.0:1789050176.207472:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691604096 00000100:00080000:1.0:1789050176.207585:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050176.207664:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 36 00000100:00100000:3.0:1789050176.207674:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+12:2350:x1875954691604096:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050176.207730:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+12:2350:x1875954691604096:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 58us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050176.207736:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 36 00000100:00100000:1.0:1789050176.212041:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050176.212086:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050176.212111:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050176.212119:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691604352 00000100:00100000:3.0:1789050176.212129:0:15086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691604352 00000100:00100000:1.0:1789050176.212146:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050176.212171:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050176.212191:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691604224 00000100:00100000:1.0:1789050176.212195:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691604224 00000100:00100000:1.0:1789050176.212247:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691604608 00000100:00100000:1.0:1789050176.212251:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691604608 00000100:00100000:0.0:1789050176.212827:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691604480 00000100:00100000:0.0:1789050176.212833:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691604480 00000100:00100000:0.0:1789050176.212877:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 37 00000100:00100000:0.0:1789050176.212887:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4f0987f-dea0-495c-a722-34140a8b12d4+6:2349:x1875954691604480:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789050176.212973:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4f0987f-dea0-495c-a722-34140a8b12d4+6:2349:x1875954691604480:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 86us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050176.212980:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 37 00000100:00100000:3.0:1789050176.216106:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691604736 00000100:00100000:3.0:1789050176.216121:0:15086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691604736 00000100:00100000:2.0:1789050176.216149:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 20 00000100:00100000:2.0:1789050176.216243:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+6:2349:x1875954691604352:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050176.216322:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+6:2349:x1875954691604352:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 162us (4236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050176.223835:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 19 00000100:00100000:3.0:1789050176.223858:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+5:2346:x1875954691604224:12345-192.168.206.1@tcp:9:kworker.0 00000020:00000080:3.0:1789050176.223890:0:15086:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79e16 00000100:00080000:3.0:1789050176.223911:0:15086:0:(import.c:65:import_set_state_nolock()) ffff95073cbc1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789050176.223979:0:15086:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1789050176.224285:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+2:2346:x1875954691604224:12345-192.168.206.1@tcp:9:kworker.0 Request processed in 436us (12172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050176.224293:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 19 00000100:00100000:3.0:1789050176.224315:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 20 00000100:00100000:3.0:1789050176.224323:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4f0987f-dea0-495c-a722-34140a8b12d4+5:2346:x1875954691604608:12345-192.168.206.1@tcp:9:kworker.0 00000020:00000080:3.0:1789050176.224351:0:15086:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79e4e 00000100:00080000:3.0:1789050176.224357:0:15086:0:(import.c:65:import_set_state_nolock()) ffff950605abb000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789050176.224399:0:15086:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1789050176.224493:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4f0987f-dea0-495c-a722-34140a8b12d4+2:2346:x1875954691604608:12345-192.168.206.1@tcp:9:kworker.0 Request processed in 170us (12347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050176.224500:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 20 00000100:00100000:3.0:1789050176.224517:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 21 00000100:00100000:3.0:1789050176.224526:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4f0987f-dea0-495c-a722-34140a8b12d4+5:2346:x1875954691604736:12345-192.168.206.1@tcp:9:kworker.0 00000020:00000080:3.0:1789050176.224539:0:15086:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79e55 00000100:00080000:3.0:1789050176.224547:0:15086:0:(import.c:65:import_set_state_nolock()) ffff950605abc800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789050176.224592:0:15086:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:3.0:1789050176.225037:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4f0987f-dea0-495c-a722-34140a8b12d4+2:2346:x1875954691604736:12345-192.168.206.1@tcp:9:kworker.0 Request processed in 511us (12863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050176.225044:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 21 00010000:00010000:3.0:1789050176.225119:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050176.225348:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050176.229223:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050176.229339:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 20 00000100:00080000:1.0:1789050176.229355:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789050176.229362:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789050176.230165:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789050176.396292:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050177.419874:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050178.446406:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789050178.787613:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f4f0987f-dea0-495c-a722-34140a8b12d4 00000020:00000080:2.0:1789050178.787627:0:7634:0:(genops.c:885:class_export_put()) final put ffff950605abc000/f4f0987f-dea0-495c-a722-34140a8b12d4 00000020:00000080:1.0:1789050178.787744:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff950605abc000/f4f0987f-dea0-495c-a722-34140a8b12d4 for lustre-OST0001 00000020:00000080:1.0:1789050178.787818:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950605abc800 for lustre-OST0001 00000040:00080000:1.0:1789050179.214177:0:14435:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789050179.214184:0:14435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789050179.214255:0:14435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789050179.214262:0:14435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:00080000:0.0:1789050179.292386:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00080000:0.0:1789050179.292405:0:5839:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967535 batchid updated 00000020:00080000:3.0:1789050179.292463:0:14439:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967535 00000020:00080000:3.0:1789050179.292475:0:14439:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967535 00010000:00010000:3.0:1789050179.474103:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050179.727554:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3283:1875954704161280:0@lo:400:kworker.0 00000100:00100000:3.0:1789050179.727619:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050179.727671:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c271500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704161792:0@lo:400:kworker.0 00000100:00100000:3.0:1789050179.727703:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050179.727731:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789050179.727737:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704161664:0@lo:400:kworker.0 00000100:00100000:3.0:1789050179.727784:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050179.727815:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f42e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704162176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050179.727841:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050179.727892:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704161408:0@lo:400:kworker.0 00000100:00100000:1.0:1789050179.727958:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704162176 00000100:00100000:1.0:1789050179.727966:0:15090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704162176 00000100:00100000:0.0:1789050179.728018:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704161536:0@lo:400:kworker.0 00000100:00100000:1.0:1789050179.728020:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789050179.728035:0:15090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704162176:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050179.728057:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050179.728077:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f42c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704162048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050179.728097:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1789050179.728430:0:15090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789050179.728455:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789050179.728482:0:15090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704162176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 450us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050179.728491:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789050179.728507:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f42e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704162176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789050179.728590:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704162048 00000100:00100000:1.0:1789050179.728595:0:15090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704162048 00000100:00100000:1.0:1789050179.728629:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789050179.728636:0:15090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704162048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050179.728654:0:15090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789050179.728689:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789050179.728691:0:15090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704162048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050179.728709:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789050179.728750:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f42c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704162048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789050179.729161:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050179.729195:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c271f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704161920:0@lo:400:kworker.0 00000100:00100000:0.0:1789050179.729261:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704161792 00000100:00100000:0.0:1789050179.729266:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704161792 00000100:00100000:0.0:1789050179.729304:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704161664 00000100:00100000:0.0:1789050179.729307:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704161664 00000100:00100000:0.0:1789050179.729331:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789050179.729339:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704161792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050179.729440:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704161536 00000100:00100000:1.0:1789050179.729445:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704161536 00000100:00100000:1.0:1789050179.729470:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704161408 00000100:00100000:1.0:1789050179.729472:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704161408 00000100:00100000:1.0:1789050179.729488:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789050179.729494:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c028700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704161536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050179.729534:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c028700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704161536:12345-0@lo:400:kworker.0 Request processed in 39us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050179.729541:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789050179.729553:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789050179.729559:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704161408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050179.729587:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704161408:12345-0@lo:400:kworker.0 Request processed in 27us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050179.729593:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789050179.729625:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704161536:0@lo:400:kworker.0 00000100:00100000:3.0:1789050179.729707:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050179.729732:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704161408:0@lo:400:kworker.0 00000100:00100000:0.0:1789050179.729826:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704161792:12345-0@lo:400:kworker.0 Request processed in 488us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050179.729841:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789050179.729862:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704161920 00000100:00100000:0.0:1789050179.729866:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704161920 00000100:00100000:0.0:1789050179.729885:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789050179.729891:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704161664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050179.730229:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704161664:0@lo:400:kworker.0 00000100:00100000:3.0:1789050179.730241:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c271500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704161792:0@lo:400:kworker.0 00000100:00100000:0.0:1789050179.730312:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704161664:12345-0@lo:400:kworker.0 Request processed in 117us (2224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050179.730319:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789050179.730333:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789050179.730340:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704161920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050179.731145:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704161920:12345-0@lo:400:kworker.0 Request processed in 803us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050179.731153:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789050179.731188:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704161280 00000100:00100000:0.0:1789050179.731193:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704161280 00000100:00100000:0.0:1789050179.731258:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789050179.731266:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f1fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3283:x1875954704161280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050179.731300:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f1fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3283:x1875954704161280:12345-0@lo:400:kworker.0 Request processed in 35us (3681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050179.731305:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1789050179.731339:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050179.731651:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c271f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704161920:0@lo:400:kworker.0 00000100:00100000:3.0:1789050179.731753:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3283:1875954704161280:0@lo:400:kworker.0 00000001:00100000:3.0:1789050180.307172:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f4f0987f-dea0-495c-a722-34140a8b12d4 00000020:00000080:3.0:1789050180.307184:0:6698:0:(genops.c:885:class_export_put()) final put ffff950605abd800/f4f0987f-dea0-495c-a722-34140a8b12d4 00000001:00100000:3.0:1789050180.309014:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 66ca7618-37f8-428a-932b-a194d1b4ace8 00000020:00000080:3.0:1789050180.309023:0:6698:0:(genops.c:885:class_export_put()) final put ffff95073cbc5000/66ca7618-37f8-428a-932b-a194d1b4ace8 00000020:00000080:1.0:1789050180.309099:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff950605abd800/f4f0987f-dea0-495c-a722-34140a8b12d4 for lustre-OST0000 00000020:00000080:1.0:1789050180.309168:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95073cbc5000/66ca7618-37f8-428a-932b-a194d1b4ace8 for lustre-OST0000 00000020:00000080:1.0:1789050180.309218:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950605abb000 for lustre-OST0000 00000020:00000080:1.0:1789050180.309224:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95073cbc1000 for lustre-OST0000 00010000:00010000:2.0:1789050180.491542:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050181.323500:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050181.323539:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050181.323563:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050181.323586:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050181.323611:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691605120 00000100:00100000:2.0:1789050181.323620:0:15088:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691605120 00000100:00100000:2.0:1789050181.323685:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 23 00000100:00100000:2.0:1789050181.323697:0:15088:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+6:2347:x1875954691605120:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050181.323765:0:15088:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+6:2347:x1875954691605120:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 70us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050181.323772:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 23 00000100:00100000:2.0:1789050181.323794:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691604992 00000100:00100000:2.0:1789050181.323799:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691604992 00000100:00100000:2.0:1789050181.323824:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691605248 00000100:00100000:2.0:1789050181.323827:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691605248 00000100:00100000:2.0:1789050181.323851:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 41 00000100:00100000:2.0:1789050181.323857:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+11:2347:x1875954691604992:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050181.323883:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+11:2347:x1875954691604992:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 26us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050181.323889:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 41 00000100:00100000:2.0:1789050181.323901:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 42 00000100:00100000:2.0:1789050181.323913:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+6:2347:x1875954691605248:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050181.323959:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4f0987f-dea0-495c-a722-34140a8b12d4+6:2347:x1875954691605248:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 46us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050181.323965:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 42 00000100:00080000:2.0:1789050181.323986:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789050181.323990:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789050181.326229:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691604864 00000100:00100000:3.0:1789050181.326241:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691604864 00000100:00100000:3.0:1789050181.326295:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 127 00000100:00100000:3.0:1789050181.326305:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f1fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:2347:x1875954691604864:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050181.326369:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f1fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:2347:x1875954691604864:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 66us (2876us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050181.326377:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 127 00010000:00010000:3.0:1789050181.515547:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050182.542411:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789050182.603006:0:17339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 10:23:02 (1789050182) 00010000:00010000:2.0:1789050183.563386:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050184.587648:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050184.844040:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050184.844063:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073f42c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704162304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050184.844126:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050184.845362:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704162816:0@lo:400:kworker.0 00000100:00100000:0.0:1789050184.845415:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050184.845440:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789050184.845445:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704162688:0@lo:400:kworker.0 00000100:00100000:0.0:1789050184.845479:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050184.845545:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c02a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3284:1875954704162432:0@lo:400:kworker.0 00000100:00100000:3.0:1789050184.845574:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050184.845605:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704162944:0@lo:400:kworker.0 00000100:00100000:3.0:1789050184.845624:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050184.845641:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789050184.845646:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c02bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704162560:0@lo:400:kworker.0 00000100:00100000:3.0:1789050184.845667:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050184.845723:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704162432 00000100:00100000:0.0:1789050184.845730:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704162432 00000100:00100000:0.0:1789050184.845773:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789050184.845781:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507372f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3284:x1875954704162432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050184.845821:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507372f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3284:x1875954704162432:12345-0@lo:400:kworker.0 Request processed in 41us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050184.845828:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789050184.845903:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c02a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3284:1875954704162432:0@lo:400:kworker.0 00000100:00100000:2.0:1789050184.846083:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704162816 00000100:00100000:2.0:1789050184.846087:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704162816 00000100:00100000:2.0:1789050184.846125:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704162688 00000100:00100000:2.0:1789050184.846128:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704162688 00000100:00100000:2.0:1789050184.846138:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704162944 00000100:00100000:2.0:1789050184.846140:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704162944 00000100:00100000:2.0:1789050184.846153:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789050184.846158:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704162816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050184.846192:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704162816:12345-0@lo:400:kworker.0 Request processed in 34us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050184.846218:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789050184.846230:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789050184.846236:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704162688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050184.846260:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704162688:12345-0@lo:400:kworker.0 Request processed in 25us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050184.846265:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789050184.846283:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789050184.846289:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704162944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050184.846313:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875954704162944:12345-0@lo:400:kworker.0 Request processed in 24us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050184.846317:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789050184.846359:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704162304 00000100:00100000:1.0:1789050184.846365:0:15090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704162304 00000100:00100000:2.0:1789050184.846370:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c19e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704163072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789050184.846404:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050184.846404:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789050184.846422:0:15090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704162304:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050184.846438:0:15848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704162560 00000100:00100000:2.0:1789050184.846443:0:15848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704162560 00002000:00000024:1.0:1789050184.846450:0:15090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789050184.846476:0:15848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789050184.846485:0:15848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704162560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050184.846494:0:15090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704162304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (2366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050184.846502:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789050184.846516:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704163072 00000100:00100000:1.0:1789050184.846519:0:15090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704163072 00000100:00100000:2.0:1789050184.846523:0:15848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704162560:12345-0@lo:400:kworker.0 Request processed in 38us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050184.846531:0:15848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789050184.846539:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789050184.846546:0:15090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704163072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789050184.846563:0:15090:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789050184.846569:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073f42c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704162304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789050184.846598:0:15090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704163072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050184.846605:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789050184.846630:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c19e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704163072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050184.846701:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c02bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704162560:0@lo:400:kworker.0 00000100:00100000:3.0:1789050184.846711:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704162944:0@lo:400:kworker.0 00000100:00080000:0.0:1789050184.846768:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789050184.846772:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789050184.846774:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050184.846791:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704162688:0@lo:400:kworker.0 00000100:00100000:0.0:1789050184.846802:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704162816:0@lo:400:kworker.0 00010000:00010000:2.0:1789050185.611498:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050186.061567:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050186.062878:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691605376 00000100:00100000:0.0:1789050186.062891:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691605376 00000100:00100000:0.0:1789050186.062976:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:0.0:1789050186.062987:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:2350:x1875954691605376:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050186.063002:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050186.063021:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950702c51e00/0x9df728c939b79dfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fbac expref: 13 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050186.063039:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050186.063107:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:656da5f8-c3d1-4665-81e8-e4fab3402cd9+12:2350:x1875954691605376:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 122us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050186.063114:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:1.0:1789050186.063392:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050186.063466:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050186.063494:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050186.063514:0:16518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691605504 00000100:00100000:1.0:1789050186.063518:0:16518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691605504 00000100:00100000:1.0:1789050186.063546:0:16518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691605632 00000100:00100000:1.0:1789050186.063550:0:16518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691605632 00000100:00100000:1.0:1789050186.063566:0:16518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00100000:1.0:1789050186.063574:0:16518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:656da5f8-c3d1-4665-81e8-e4fab3402cd9+13:2347:x1875954691605504:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050186.063582:0:16518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050186.063592:0:16518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703331400/0x9df728c939b79e01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fbd6 expref: 13 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050186.063616:0:16518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050186.063659:0:16518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:656da5f8-c3d1-4665-81e8-e4fab3402cd9+12:2347:x1875954691605504:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 86us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050186.063667:0:16518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00100000:1.0:1789050186.063681:0:16518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:1.0:1789050186.063688:0:16518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:656da5f8-c3d1-4665-81e8-e4fab3402cd9+11:2347:x1875954691605632:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050186.063696:0:16518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050186.063705:0:16518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95070f05e000/0x9df728c939b79ea2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc77 expref: 11 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050186.063713:0:16518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050186.063728:0:16518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:656da5f8-c3d1-4665-81e8-e4fab3402cd9+10:2347:x1875954691605632:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 42us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050186.063734:0:16518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:3.0:1789050186.065858:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691605888 00000100:00100000:3.0:1789050186.065869:0:15086:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691605888 00000100:00100000:3.0:1789050186.065955:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 22 00000100:00100000:3.0:1789050186.065966:0:15086:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+6:2346:x1875954691605888:12345-192.168.206.1@tcp:9:umount.0 00000020:00000080:3.0:1789050186.065999:0:15086:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79e1d 00000020:00010000:3.0:1789050186.066006:0:15086:0:(genops.c:1920:obd_stale_export_put()) Put export ffff95073cbc0000: total 0 00000100:00080000:3.0:1789050186.066010:0:15086:0:(import.c:65:import_set_state_nolock()) ffff95073cbc4000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789050186.066051:0:15086:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:3.0:1789050186.066333:0:15086:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66ca7618-37f8-428a-932b-a194d1b4ace8+4:2346:x1875954691605888:12345-192.168.206.1@tcp:9:umount.0 Request processed in 369us (2837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050186.066341:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 22 00000100:00080000:0.0:1789050186.067809:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:1.0:1789050186.068108:0:14390:0:(genops.c:1906:obd_stale_export_get()) Get export ffff95073cbc0000: total 0 00010000:00010000:1.0:1789050186.068114:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050186.068161:0:14390:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff95073cbc0000, canceled 0 locks, left on hash table 1. 00002000:00010000:1.0:1789050186.068193:0:14390:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789050186.068220:0:14390:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1789050168894000000 -> 1789050169698467515 00002000:00010000:1.0:1789050186.068224:0:14390:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789050168894000000 -> 1789050169698467515 00002000:00010000:1.0:1789050186.068227:0:14390:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1789050186.068255:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d02f6a71/0x9df728c939b7a15e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd50 expref: 3 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050186.068281:0:14390:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff95073cbc0000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789050186.068292:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050186.068294:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050186.068296:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050186.082497:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050186.082572:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691606784 00000100:00100000:2.0:1789050186.082582:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691606784 00000100:00100000:2.0:1789050186.082658:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 64 00000100:00100000:2.0:1789050186.082669:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+11:2346:x1875954691606784:12345-192.168.206.1@tcp:39:umount.0 00000020:00000080:2.0:1789050186.082699:0:14403:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79e0f 00000020:00010000:2.0:1789050186.082715:0:14403:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9506046d1800: total 0 00000100:00080000:2.0:1789050186.082720:0:14403:0:(import.c:65:import_set_state_nolock()) ffff9506046d0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789050186.082751:0:14403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000020:00010000:1.0:1789050186.083499:0:14389:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9506046d1800: total 0 00010000:00010000:1.0:1789050186.083542:0:14389:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff9506046d1800, canceled 0 locks, left on hash table 6. 00010000:00010000:1.0:1789050186.083573:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff950714b52a00) 00010000:00010000:1.0:1789050186.083577:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050186.083585:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331600/0x9df728c939b79eda lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc85 expref: 12 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050186.083609:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:1.0:1789050186.083612:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789050186.083616:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51800/0x9df728c939b79f12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc93 expref: 11 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050186.083629:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff95072c9b1f00) 00010000:00010000:1.0:1789050186.083631:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789050186.083635:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c51c00/0x9df728c939b7a10a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd2d expref: 10 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050186.083649:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9507102a3b00) 00010000:00010000:1.0:1789050186.083652:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789050186.083656:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05f600/0x9df728c939b79ebe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc7e expref: 9 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050186.083669:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff95072c9b1d00) 00010000:00010000:1.0:1789050186.083672:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789050186.083675:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950702c50600/0x9df728c939b79f97 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fcbd expref: 8 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050186.083689:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff95072c9b1600) 00010000:00010000:1.0:1789050186.083699:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789050186.083704:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95073c531e00/0x9df728c939b7a0af lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd18 expref: 7 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050186.083718:0:14389:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff9506046d1800, canceled 6 locks, left on hash table 0. 00010000:00010000:1.0:1789050186.083731:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050186.083733:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050186.083735:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789050186.083808:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050186.083951:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66ca7618-37f8-428a-932b-a194d1b4ace8+3:2346:x1875954691606784:12345-192.168.206.1@tcp:39:umount.0 Request processed in 1283us (1462us total) trans 8589934639 rc 0/0 00000100:00100000:2.0:1789050186.083960:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 64 00000100:00100000:3.0:1789050186.442323:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050186.442495:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691606912 00000100:00100000:2.0:1789050186.442505:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691606912 00000100:00100000:2.0:1789050186.442582:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 46 00000100:00100000:2.0:1789050186.442593:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4f0987f-dea0-495c-a722-34140a8b12d4+6:2349:x1875954691606912:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050186.442669:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4f0987f-dea0-495c-a722-34140a8b12d4+6:2349:x1875954691606912:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 78us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050186.442681:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 46 00000100:00080000:0.0:1789050186.442792:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789050186.635441:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050187.660692:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050187.692759:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050187.692811:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050187.692850:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050187.692938:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691607040 00000100:00100000:2.0:1789050187.692954:0:16518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691607168 00000100:00100000:3.0:1789050187.692959:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691607040 00000100:00100000:2.0:1789050187.692962:0:16518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691607168 00000100:00100000:2.0:1789050187.693020:0:16518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691607296 00000100:00100000:2.0:1789050187.693024:0:16518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691607296 00000100:00100000:2.0:1789050187.693043:0:16518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:2.0:1789050187.693054:0:16518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:656da5f8-c3d1-4665-81e8-e4fab3402cd9+12:2348:x1875954691607168:12345-192.168.206.1@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789050187.693061:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 8 00010000:00010000:2.0:1789050187.693070:0:16518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789050187.693072:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c517480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+12:2348:x1875954691607296:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050187.693081:0:14386:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050187.693089:0:16518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703331800/0x9df728c939b79e39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc38 expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050187.693095:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703331000/0x9df728c939b79e9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc70 expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050187.693109:0:16518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050187.693110:0:14386:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050187.693156:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c517480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+10:2348:x1875954691607296:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 86us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050187.693163:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:3.0:1789050187.693178:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:3.0:1789050187.693184:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073f42e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+9:2347:x1875954691607040:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050187.693191:0:14386:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050187.693288:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073c531600/0x9df728c939b79e32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc0e expref: 9 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050187.693300:0:14386:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050187.693450:0:16518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:656da5f8-c3d1-4665-81e8-e4fab3402cd9+8:2348:x1875954691607168:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 397us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050187.693458:0:16518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:3.0:1789050187.694681:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073f42e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:656da5f8-c3d1-4665-81e8-e4fab3402cd9+7:2347:x1875954691607040:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 1490us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050187.694691:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:1.0:1789050187.701967:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050187.702156:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691607552 00000100:00100000:3.0:1789050187.702166:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691607552 00000100:00100000:3.0:1789050187.702262:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 65 00000100:00100000:3.0:1789050187.702272:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+6:2346:x1875954691607552:12345-192.168.206.1@tcp:39:umount.0 00000020:00000080:3.0:1789050187.702309:0:14402:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79e47 00000020:00010000:3.0:1789050187.702318:0:14402:0:(genops.c:1920:obd_stale_export_put()) Put export ffff95073c7e0000: total 0 00000100:00080000:3.0:1789050187.702336:0:14402:0:(import.c:65:import_set_state_nolock()) ffff95073c7e4000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789050187.702363:0:14402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934639 00000100:00100000:3.0:1789050187.702569:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4f0987f-dea0-495c-a722-34140a8b12d4+5:2346:x1875954691607552:12345-192.168.206.1@tcp:39:umount.0 Request processed in 298us (610us total) trans 8589934640 rc 0/0 00000100:00100000:3.0:1789050187.702577:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 65 00000020:00010000:1.0:1789050187.702834:0:14389:0:(genops.c:1906:obd_stale_export_get()) Get export ffff95073c7e0000: total 0 00010000:00010000:1.0:1789050187.702875:0:14389:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff95073c7e0000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789050187.702919:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95072c9b1c00) 00010000:00010000:1.0:1789050187.702923:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789050187.702931:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95070f05e600/0x9df728c939b79f20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fc9a expref: 4 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050187.702952:0:14389:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff95073c7e0000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789050187.702964:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050187.702965:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050187.702967:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050187.722764:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050187.722856:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691607808 00000100:00100000:3.0:1789050187.722866:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691607808 00000100:00100000:3.0:1789050187.722934:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 129 00000100:00100000:3.0:1789050187.722945:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507372f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+7:2346:x1875954691607808:12345-192.168.206.1@tcp:251:umount.0 00000020:00000080:3.0:1789050187.722985:0:14396:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79dec 00000020:00010000:3.0:1789050187.722992:0:14396:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9506046d3000: total 0 00000100:00080000:3.0:1789050187.722996:0:14396:0:(import.c:65:import_set_state_nolock()) ffff9506046d2000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789050187.723079:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507372f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656da5f8-c3d1-4665-81e8-e4fab3402cd9+3:2346:x1875954691607808:12345-192.168.206.1@tcp:251:umount.0 Request processed in 135us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050187.723088:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 129 00000020:00010000:2.0:1789050187.723105:0:15850:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9506046d3000: total 0 00010000:00010000:2.0:1789050187.723123:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050187.723168:0:15850:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff9506046d3000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789050187.723228:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95070f05ec00/0x9df728c939b79df3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fba5 expref: 2 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050187.723245:0:15850:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff9506046d3000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789050187.723256:0:15850:0:(genops.c:885:class_export_put()) final put ffff9506046d3000/656da5f8-c3d1-4665-81e8-e4fab3402cd9 00010000:00010000:2.0:1789050187.723273:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050187.723275:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050187.723277:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789050187.723925:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9506046d3000/656da5f8-c3d1-4665-81e8-e4fab3402cd9 for MGS 00000020:00000080:3.0:1789050187.723955:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9506046d2000 for MGS 00010000:00010000:1.0:1789050188.685906:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789050188.996493:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 66ca7618-37f8-428a-932b-a194d1b4ace8 00000020:00000080:2.0:1789050188.996502:0:7634:0:(genops.c:885:class_export_put()) final put ffff95073cbc0000/66ca7618-37f8-428a-932b-a194d1b4ace8 00000020:00000080:2.0:1789050188.996532:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95073cbc0000/66ca7618-37f8-428a-932b-a194d1b4ace8 for lustre-OST0001 00000020:00000080:2.0:1789050188.996578:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95073cbc4000 for lustre-OST0001 00000020:01000004:3.0:1789050189.326541:0:17538:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789050189.339175:0:17538:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789050189.339261:0:17538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331200/0x9df728c939b79b1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b22 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050189.339277:0:17538:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331200/0x9df728c939b79b1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79b22 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050189.339285:0:17538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331200/0x9df728c939b79b1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79b22 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050189.339291:0:17538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff950703331200/0x9df728c939b79b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79b22 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050189.339321:0:17538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789050189.339328:0:17538:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789050189.339349:0:17538:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789050189.339353:0:17538:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789050189.339360:0:17538:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789050189.339384:0:17538:0:(import.c:65:import_set_state_nolock()) ffff9507060b1000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1789050189.339452:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050189.339459:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950703331200/0x9df728c939b79b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79b22 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050189.339467:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331200 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:1.0:1789050189.339476:0:14389:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950703331200/0x9df728c939b79b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79b22 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050189.339485:0:14389:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950703331200/0x9df728c939b79b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b79b22 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050189.339492:0:14389:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950703331200/0x9df728c939b79b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b79b22 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050189.339498:0:14389:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789050189.339500:0:14389:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789050189.339503:0:14389:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789050189.339526:0:14389:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950703331200/0x9df728c939b79b1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79b22 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050189.339532:0:14389:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789050189.339564:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950703331200/0x9df728c939b79b1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79b22 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050189.339572:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950703331200/0x9df728c939b79b1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79b22 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050189.339583:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050189.339585:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050189.339587:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050189.339633:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3282:1875954704163328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050189.339710:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050189.339832:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875954704163200:0@lo:39:umount.0 00000100:00100000:1.0:1789050189.339847:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704163328 00000100:00100000:1.0:1789050189.339854:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704163328 00000100:00100000:0.0:1789050189.339864:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050189.339911:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789050189.339920:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950605751c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+19:3282:x1875954704163328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789050189.339932:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050189.339946:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073c530600/0x9df728c939b79b22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b79b1b expref: 19 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050189.340040:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050189.340090:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950605751c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:3282:x1875954704163328:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050189.340097:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789050189.340185:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704163200 00000100:00100000:2.0:1789050189.340189:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704163200 00000100:00100000:2.0:1789050189.340248:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789050189.340256:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875954704163200:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789050189.340276:0:14401:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79b4c 00000100:00080000:2.0:1789050189.340284:0:14401:0:(import.c:65:import_set_state_nolock()) ffff9507033bd800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789050189.340335:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3281:x1875954704163200:12345-0@lo:39:umount.0 Request processed in 80us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050189.340341:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000020:00000080:2.0:1789050189.340348:0:14401:0:(genops.c:885:class_export_put()) final put ffff9507033bd000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1789050189.340374:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789050189.340382:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9507033bd000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789050189.340427:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9507033bd800 for lustre-MDT0000 00000100:00100000:0.0:1789050189.340644:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3282:1875954704163328:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789050189.341117:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9507060b1000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789050189.341135:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875954704163200:0@lo:39:umount.0 00000100:00080000:3.0:1789050189.341237:0:17538:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789050189.341241:0:17538:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789050189.341245:0:17538:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789050189.342441:0:17538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331a00/0x9df728c939b79a81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79a88 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.342694:0:17538:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331a00/0x9df728c939b79a81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79a88 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.342705:0:17538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331a00/0x9df728c939b79a81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79a88 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.342712:0:17538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff950703331a00/0x9df728c939b79a81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79a88 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.342736:0:17538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050189.342742:0:17538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b79dde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79de5 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.342749:0:17538:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b79dde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79de5 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.342756:0:17538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b79dde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79de5 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.342761:0:17538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b79dde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79de5 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.342849:0:17538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789050189.342868:0:17538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530800/0x9df728c939b79e8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79e94 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.342875:0:17538:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530800/0x9df728c939b79e8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79e94 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.342881:0:17538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530800/0x9df728c939b79e8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79e94 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.342896:0:17538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff95073c530800/0x9df728c939b79e8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79e94 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050189.343878:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789050189.343897:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950703331a00/0x9df728c939b79a81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79a88 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050189.343907:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331a00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:1.0:1789050189.343910:0:14390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950703331a00/0x9df728c939b79a81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79a88 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050189.343919:0:14390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950703331a00/0x9df728c939b79a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b79a88 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050189.343926:0:14390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950703331a00/0x9df728c939b79a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b79a88 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050189.343932:0:14390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789050189.343935:0:14390:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1789050189.344030:0:14390:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950703331a00/0x9df728c939b79a81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79a88 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050189.344037:0:14390:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789050189.344131:0:17538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789050189.344145:0:15850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789050189.344150:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b79dde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79de5 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.344157:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331e00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:2.0:1789050189.344160:0:15850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b79dde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79de5 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.344168:0:15850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b79dde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b79de5 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050189.344264:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3283:1875954704163456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050189.344326:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789050189.344408:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950703331a00/0x9df728c939b79a81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79a88 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050189.344416:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950703331a00/0x9df728c939b79a81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79a88 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050189.344445:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050189.344449:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95073c530800/0x9df728c939b79e8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79e94 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050189.344455:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c530800 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:2.0:1789050189.344544:0:15850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b79dde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b79de5 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050189.344552:0:15850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789050189.344554:0:15850:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789050189.344557:0:15850:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789050189.344577:0:15850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b79dde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79de5 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.344590:0:15850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789050189.344711:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b79dde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79de5 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.344719:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b79dde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79de5 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.344733:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050189.344735:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050189.344737:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050189.344753:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704163456 00000100:00100000:2.0:1789050189.344760:0:14387:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704163456 00000100:00100000:2.0:1789050189.344810:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789050189.344819:0:14387:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c029500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:3283:x1875954704163456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789050189.344831:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050189.344844:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950605f06a00/0x9df728c939b79a88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b79a81 expref: 18 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.344854:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:1.0:1789050189.344955:0:14390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95073c530800/0x9df728c939b79e8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79e94 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050189.345036:0:14390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073c530800/0x9df728c939b79e8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b79e94 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050189.345045:0:14390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073c530800/0x9df728c939b79e8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b79e94 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050189.345050:0:14390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789050189.345052:0:14390:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789050189.345054:0:14390:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789050189.345072:0:14390:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95073c530800/0x9df728c939b79e8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79e94 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050189.345078:0:14390:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789050189.345085:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95073c530800/0x9df728c939b79e8d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79e94 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050189.345091:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073c530800/0x9df728c939b79e8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79e94 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050189.345100:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050189.345102:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050189.345110:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050189.345190:0:14387:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c029500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+17:3283:x1875954704163456:12345-0@lo:103:ldlm_bl.0 Request processed in 372us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050189.345221:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789050189.345244:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3285:1875954704163712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050189.345270:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050189.345298:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789050189.345303:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c19ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3285:1875954704163584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050189.345321:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050189.345351:0:16518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704163712 00000100:00100000:2.0:1789050189.345356:0:16518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704163712 00000100:00100000:2.0:1789050189.345376:0:16518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704163584 00000100:00100000:2.0:1789050189.345378:0:16518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704163584 00000100:00100000:2.0:1789050189.345390:0:16518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789050189.345395:0:16518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+18:3285:x1875954704163712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789050189.345403:0:16518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050189.345413:0:16518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950702c50800/0x9df728c939b79e94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b79e8d expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.345421:0:16518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050189.345445:0:16518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+17:3285:x1875954704163712:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050189.345451:0:16518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789050189.345477:0:16518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789050189.345482:0:16518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c19e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+16:3285:x1875954704163584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789050189.345489:0:16518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050189.345497:0:16518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95070f05ee00/0x9df728c939b79de5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b79dde expref: 16 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.345507:0:16518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050189.345525:0:16518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c19e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+15:3285:x1875954704163584:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050189.345531:0:16518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789050189.345556:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c19ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3285:1875954704163584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050189.345564:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3285:1875954704163712:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789050189.345591:0:17538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c531400/0x9df728c939b79a73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79a7a expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.345618:0:17538:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c531400/0x9df728c939b79a73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79a7a expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.345625:0:17538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c531400/0x9df728c939b79a73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79a7a expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.345632:0:17538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff95073c531400/0x9df728c939b79a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79a7a expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.345642:0:17538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789050189.345645:0:17538:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789050189.345658:0:17538:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789050189.345683:0:17538:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789050189.345687:0:17538:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789050189.345691:0:17538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789050189.345697:0:17538:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:2.0:1789050189.345701:0:17538:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff950604d72800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789050189.345706:0:17538:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff95073d231800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789050189.345712:0:17538:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff95073c7e0000 f4f0987f-dea0-495c-a722-34140a8b12d4 192.168.206.1@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1789050189.345717:0:17538:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9506046d1800 66ca7618-37f8-428a-932b-a194d1b4ace8 192.168.206.1@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934638 stale:0 00000020:00080000:2.0:1789050189.345722:0:17538:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff95073d22cd40) has exports, disconnecting them 00000020:00080000:2.0:1789050189.345726:0:17538:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff950604d72800), last request at 1789050184 00000020:00000080:2.0:1789050189.345732:0:17538:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79c41 00000100:00080000:2.0:1789050189.345746:0:17538:0:(import.c:65:import_set_state_nolock()) ffff950604d77000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789050189.345780:0:15850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050189.345785:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95073c531400/0x9df728c939b79a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79a7a expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.345797:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c531400 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:2.0:1789050189.345800:0:15850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95073c531400/0x9df728c939b79a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79a7a expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.345807:0:15850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073c531400/0x9df728c939b79a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b79a7a expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789050189.345812:0:15850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073c531400/0x9df728c939b79a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b79a7a expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050189.345817:0:15850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789050189.345819:0:15850:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789050189.345821:0:15850:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789050189.345835:0:15850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95073c531400/0x9df728c939b79a73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79a7a expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.345840:0:15850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789050189.345850:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95073c531400/0x9df728c939b79a73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79a7a expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.345856:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073c531400/0x9df728c939b79a73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79a7a expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050189.345868:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050189.345869:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050189.345871:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789050189.345895:0:17538:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff950604d72800): rc 0 00000020:00000080:2.0:1789050189.345897:0:17538:0:(genops.c:885:class_export_put()) final put ffff950604d72800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789050189.345907:0:17538:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff95073d231800), last request at 1789050184 00000020:00000080:2.0:1789050189.345916:0:17538:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79bd1 00000100:00080000:2.0:1789050189.345921:0:17538:0:(import.c:65:import_set_state_nolock()) ffff95073d236000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1789050189.345934:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff950604d72800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789050189.345986:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950604d77000 for lustre-MDT0000 00000020:00080000:2.0:1789050189.346002:0:17538:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95073d231800): rc 0 00000020:00000080:2.0:1789050189.346004:0:17538:0:(genops.c:885:class_export_put()) final put ffff95073d231800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1789050189.346014:0:17538:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa435c383fae0 00000020:00000080:2.0:1789050189.346025:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95073d231800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789050189.346046:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95073d236000 for lustre-MDT0000 00000100:00080000:2.0:1789050189.346066:0:17538:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789050189.346069:0:17538:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1789050189.346080:0:17538:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789050189.346147:0:17538:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789050189.346161:0:17538:0:(import.c:65:import_set_state_nolock()) ffff950720630000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789050189.346172:0:17538:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789050189.346174:0:17538:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 3 00000004:00080000:2.0:1789050189.346181:0:17538:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789050189.346269:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704163968:0@lo:9:umount.0 00000100:00100000:2.0:1789050189.346305:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050189.346342:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704163968 00000100:00100000:2.0:1789050189.346347:0:15087:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704163968 00000100:00100000:2.0:1789050189.346386:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789050189.346392:0:15087:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875954704163968:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789050189.346410:0:15087:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79c4f 00000100:00080000:2.0:1789050189.346415:0:15087:0:(import.c:65:import_set_state_nolock()) ffff950604d77800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789050189.346441:0:15087:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1789050189.346738:0:15087:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3281:x1875954704163968:12345-0@lo:9:umount.0 Request processed in 344us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050189.346755:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1789050189.346774:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789050189.346784:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789050189.346804:0:3281:0:(import.c:65:import_set_state_nolock()) ffff950720630000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789050189.346813:0:3281:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789050189.346815:0:3281:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789050189.346818:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704163968:0@lo:9:umount.0 00000100:00080000:2.0:1789050189.346838:0:17538:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789050189.346848:0:17538:0:(import.c:65:import_set_state_nolock()) ffff95072f422000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789050189.346865:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704164096:0@lo:9:umount.0 00000100:00100000:2.0:1789050189.346906:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050189.346933:0:16630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704164096 00000100:00100000:2.0:1789050189.346936:0:16630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704164096 00000100:00100000:2.0:1789050189.346971:0:16630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789050189.346978:0:16630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95070469ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3281:x1875954704164096:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789050189.346991:0:16630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79c56 00000100:00080000:2.0:1789050189.346996:0:16630:0:(import.c:65:import_set_state_nolock()) ffff950604d71800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789050189.347015:0:16630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:2.0:1789050189.347234:0:16630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95070469ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3281:x1875954704164096:12345-0@lo:9:umount.0 Request processed in 255us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050189.347240:0:16630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1789050189.347359:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789050189.347366:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789050189.347380:0:3281:0:(import.c:65:import_set_state_nolock()) ffff95072f422000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789050189.347384:0:3281:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789050189.347385:0:3281:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789050189.347388:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704164096:0@lo:9:umount.0 00000020:00080000:2.0:1789050189.347434:0:17538:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff95073d22cd40) has no exports 00010000:00010000:3.0:1789050189.347880:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050189.347986:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050189.347994:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050189.348013:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c19ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3282:1875954704163840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050189.348054:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050189.349437:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3283:1875954704163456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789050189.349816:0:16518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704163840 00000100:00100000:3.0:1789050189.349823:0:16518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704163840 00000100:00100000:3.0:1789050189.349897:0:16518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789050189.349907:0:16518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c515f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+15:3282:x1875954704163840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789050189.349921:0:16518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050189.349939:0:16518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950605f06400/0x9df728c939b79a7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b79a73 expref: 15 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050189.349955:0:16518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050189.350018:0:16518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c515f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1+14:3282:x1875954704163840:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (1963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050189.350025:0:16518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789050189.350065:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c19ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3282:1875954704163840:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1789050189.355908:0:17538:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff95073d22cd40) has no exports 00000020:00000080:3.0:1789050189.406895:0:17538:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79ace 00000020:00000080:3.0:1789050189.406910:0:17538:0:(genops.c:885:class_export_put()) final put ffff95072f423800/lustre-QMT0000_UUID 00000020:01000000:3.0:1789050189.406989:0:17538:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789050189.407132:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95072f423800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789050189.407159:0:17538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789050189.407179:0:17538:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789050189.407183:0:17538:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff950702d9b380) has no exports 00000020:00000080:2.0:1789050189.407860:0:17538:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79ac7 00000020:00000080:2.0:1789050189.407867:0:17538:0:(genops.c:885:class_export_put()) final put ffff950720636000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789050189.407934:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff950720636000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789050189.408068:0:17538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789050189.408077:0:17538:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789050189.408080:0:17538:0:(genops.c:885:class_export_put()) final put ffff950720637000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789050189.408082:0:17538:0:(genops.c:844:class_export_destroy()) destroying export ffff950720637000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789050189.408087:0:17538:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:1.0:1789050189.482811:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 66ca7618-37f8-428a-932b-a194d1b4ace8 00000001:00080000:1.0:1789050189.482826:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934639 is committed 00000020:00000080:1.0:1789050189.482830:0:5839:0:(genops.c:885:class_export_put()) final put ffff9506046d1800/66ca7618-37f8-428a-932b-a194d1b4ace8 00000001:00100000:1.0:1789050189.482851:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f4f0987f-dea0-495c-a722-34140a8b12d4 00000001:00080000:1.0:1789050189.482856:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934640 is committed 00000020:00000080:1.0:1789050189.482858:0:5839:0:(genops.c:885:class_export_put()) final put ffff95073c7e0000/f4f0987f-dea0-495c-a722-34140a8b12d4 00000020:00000080:2.0:1789050189.482905:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9506046d1800/66ca7618-37f8-428a-932b-a194d1b4ace8 for lustre-MDT0000 00000020:00000080:2.0:1789050189.482976:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95073c7e0000/f4f0987f-dea0-495c-a722-34140a8b12d4 for lustre-MDT0000 00000020:00000080:2.0:1789050189.482996:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9506046d0800 for lustre-MDT0000 00000020:00000080:2.0:1789050189.483000:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95073c7e4000 for lustre-MDT0000 00010000:00010000:2.0:1789050189.708395:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050189.963704:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c272680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704164352:0@lo:400:kworker.0 00000100:00100000:3.0:1789050189.963771:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050189.963847:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704164352 00000100:00100000:3.0:1789050189.963854:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704164352 00000100:00100000:3.0:1789050189.963900:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789050189.963907:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3284:x1875954704164352:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789050189.963914:0:14402:0:(tgt_handler.c:811:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789050189.963953:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3284:x1875954704164352:12345-0@lo:400:kworker.0 Request processed in 45us (181us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789050189.963959:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1789050189.963996:0:3284:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789050189.964001:0:3284:0:(import.c:65:import_set_state_nolock()) ffff950702eb1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789050189.964004:0:3284:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1789050189.964105:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050189.964115:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704164224:0@lo:400:kworker.0 00000100:00100000:2.0:1789050189.964142:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050189.964168:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704164224 00000100:00100000:2.0:1789050189.964171:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704164224 00000100:00100000:2.0:1789050189.964193:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789050189.964218:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875954704164224:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789050189.964223:0:14401:0:(tgt_handler.c:811:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789050189.964249:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875954704164224:12345-0@lo:400:kworker.0 Request processed in 50us (106us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789050189.964254:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1789050189.964276:0:3282:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789050189.964289:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9506046d0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789050189.964293:0:3282:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789050189.964297:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9506046d0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789050189.964300:0:3282:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 364 00000100:00080000:2.0:1789050189.964308:0:3282:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9506046d0000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:2.0:1789050189.964328:0:3282:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff950720826300 x1875954704164480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789050189.964347:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704164224:0@lo:400:kworker.0 00000100:00100000:2.0:1789050189.964368:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875954704164480:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789050189.964392:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050189.964428:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704164480 00000100:00100000:2.0:1789050189.964433:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704164480 00000100:00100000:2.0:1789050189.964451:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789050189.964455:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3281:x1875954704164480:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1789050189.964468:0:14402:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789050189.964503:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3281:x1875954704164480:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 46us (109us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789050189.964508:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1789050189.964529:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9506046d0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789050189.964533:0:3281:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789050189.964536:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875954704164480:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1789050189.982418:0:3284:0:(import.c:65:import_set_state_nolock()) ffff950702eb1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789050189.982429:0:3284:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 378 00000100:00080000:3.0:1789050189.982444:0:3284:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff950702eb1800 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:3.0:1789050189.982567:0:3284:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c271880 x1875954704164608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789050189.982596:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c272680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1875954704164352:0@lo:400:kworker.0 00000100:00100000:0.0:1789050189.982701:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3281:1875954704164608:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789050189.982762:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050189.983358:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704164608 00000100:00100000:1.0:1789050189.983366:0:14401:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704164608 00000100:00100000:1.0:1789050189.983405:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789050189.983412:0:14401:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3281:x1875954704164608:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789050189.983427:0:14401:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789050189.983488:0:14401:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3281:x1875954704164608:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 76us (726us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789050189.983495:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1789050189.983737:0:3281:0:(import.c:65:import_set_state_nolock()) ffff950702eb1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789050189.983742:0:3281:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789050189.983746:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3281:1875954704164608:0@lo:38:ptlrpcd_00_02.0 00000001:00100000:0.0:1789050190.528795:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789050190.528803:0:6698:0:(genops.c:885:class_export_put()) final put ffff950604d70000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789050190.528864:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff950604d70000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789050190.528928:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950604d77800 for lustre-OST0000 00010000:00010000:3.0:1789050190.731465:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789050191.437318:0:17538:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff950704f42300 - data ffff95071067b0d8/ffff950710e7a400 00000020:01000000:2.0:1789050191.437685:0:17538:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff950706415000 - data ffff950721846ca8/ffff950710f65400 00000001:00000004:2.0:1789050191.447333:0:17538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934640 00000100:00080000:3.0:1789050191.552859:0:17538:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789050191.552880:0:17538:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1789050191.552910:0:17538:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789050191.552913:0:17538:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789050191.554673:0:14423:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789050191.554680:0:14423:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1789050191.554692:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1789050191.558889:0:17538:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789050191.558898:0:17538:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 4 00000004:00080000:3.0:1789050191.558920:0:17538:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789050191.558923:0:17538:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789050191.559922:0:14425:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789050191.559929:0:14425:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:1.0:1789050191.559941:0:14425:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1789050191.627133:0:17538:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79a96 00000020:00000080:0.0:1789050191.627149:0:17538:0:(genops.c:885:class_export_put()) final put ffff95071009f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789050191.628501:0:17538:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79aab 00000020:00000080:0.0:1789050191.628513:0:17538:0:(genops.c:885:class_export_put()) final put ffff95071009e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789050191.628634:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95071009f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789050191.628708:0:17538:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789050191.628717:0:17538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789050191.628730:0:17538:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789050191.628735:0:17538:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff95073d22b380) has no exports 00000004:01000000:0.0:1789050191.629087:0:17538:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789050191.629098:0:17538:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79af8 00000020:00000080:0.0:1789050191.629104:0:17538:0:(genops.c:885:class_export_put()) final put ffff95071009d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789050191.629129:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95071009e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789050191.629224:0:17538:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789050191.629230:0:17538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789050191.629235:0:17538:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789050191.629239:0:17538:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9507034599c0) has no exports 00000020:00000080:0.0:1789050191.629246:0:17538:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79af1 00000020:00000080:0.0:1789050191.629251:0:17538:0:(genops.c:885:class_export_put()) final put ffff95072f427800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789050191.629335:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95071009d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789050191.629433:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95072f427800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789050191.630333:0:17538:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789050191.630340:0:17538:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789050191.630345:0:17538:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 5 00000004:00080000:1.0:1789050191.630354:0:17538:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789050191.630357:0:17538:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789050191.630517:0:17538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789050191.630537:0:17538:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789050191.630547:0:17538:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79ae3 00000020:00000080:1.0:1789050191.630555:0:17538:0:(genops.c:885:class_export_put()) final put ffff95073c7e5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789050191.630575:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95072f422000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789050191.630583:0:8:0:(genops.c:885:class_export_put()) final put ffff95073c7e0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789050191.630586:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95073c7e0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789050191.630592:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789050191.630746:0:17538:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789050191.630753:0:17538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789050191.630759:0:17538:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789050191.630763:0:17538:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff950702d9cd40) has no exports 00000020:00000080:1.0:1789050191.630770:0:17538:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79adc 00000020:00000080:1.0:1789050191.630775:0:17538:0:(genops.c:885:class_export_put()) final put ffff950720633000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789050191.630803:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95073c7e5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1789050191.631478:0:17538:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789050191.631483:0:17538:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789050191.631487:0:17538:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1789050191.631493:0:17538:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789050191.631495:0:17538:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789050191.631638:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff950720633000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789050191.631720:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950720630000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789050191.631735:0:17538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789050191.631742:0:17538:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789050191.631747:0:17538:0:(genops.c:885:class_export_put()) final put ffff95072f422800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789050191.631750:0:17538:0:(genops.c:844:class_export_destroy()) destroying export ffff95072f422800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789050191.631762:0:17538:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789050191.632020:0:17538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789050191.632026:0:17538:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789050191.632030:0:17538:0:(genops.c:885:class_export_put()) final put ffff95072f436800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789050191.632033:0:17538:0:(genops.c:844:class_export_destroy()) destroying export ffff95072f436800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789050191.632038:0:17538:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789050191.632180:0:17538:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79ab2 00000020:00000080:1.0:1789050191.632188:0:17538:0:(genops.c:885:class_export_put()) final put ffff950710099800/lustre-MDD0000_UUID 00000020:01000000:1.0:1789050191.632195:0:17538:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789050191.632272:0:17538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789050191.632274:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff950710099800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789050191.632278:0:17538:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789050191.632283:0:17538:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff95073d228000) has no exports 00000020:00000080:1.0:1789050191.632304:0:17538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789050191.632319:0:17538:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789050191.632323:0:17538:0:(genops.c:885:class_export_put()) final put ffff950710099000/lustre-MDD0000_UUID 00000020:00000080:1.0:1789050191.632325:0:17538:0:(genops.c:844:class_export_destroy()) destroying export ffff950710099000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789050191.632331:0:17538:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789050191.632547:0:17538:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79ab9 00000020:00000080:1.0:1789050191.632553:0:17538:0:(genops.c:885:class_export_put()) final put ffff95071009a800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789050191.632570:0:17538:0:(tgt_mount.c:187:server_put_mount()) put mount ffff950605aa8800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789050191.632573:0:17538:0:(obd_mount.c:710:lustre_put_lsi()) put ffff950605aa8800 3 00000020:01000004:1.0:1789050191.632577:0:17538:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff950605aa8800 from lustre-MDT0000 00000020:00000080:3.0:1789050191.632586:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95071009a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789050191.632602:0:17538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789050191.632607:0:17538:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789050191.632611:0:17538:0:(genops.c:885:class_export_put()) final put ffff95071009f000/lustre-MDT0000_UUID 00000020:00000080:1.0:1789050191.632613:0:17538:0:(genops.c:844:class_export_destroy()) destroying export ffff95071009f000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789050191.632659:0:17538:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789050191.632686:0:17538:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1789050191.632691:0:17538:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789050191.632694:0:17538:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789050191.632696:0:17538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789050191.632700:0:17538:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789050191.632707:0:17538:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff95073f2df000 eecacad0-cee9-47e6-a4ee-b5aef8a75ff1 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789050191.632713:0:17538:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff950702d999c0) has exports, disconnecting them 00000020:00080000:1.0:1789050191.632719:0:17538:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff95073f2df000), last request at 1789050117 00000020:00000080:1.0:1789050191.632738:0:17538:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79a5e 00000020:00010000:1.0:1789050191.632743:0:17538:0:(genops.c:1920:obd_stale_export_put()) Put export ffff95073f2df000: total 0 00000100:00080000:1.0:1789050191.632749:0:17538:0:(import.c:65:import_set_state_nolock()) ffff95073f2da000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789050191.632807:0:17538:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95073f2df000): rc 0 00000020:00080000:1.0:1789050191.632812:0:17538:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff950702d999c0) has no exports 00000100:00100000:3.0:1789050191.633022:0:14394:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff950732c35400:14394] 0 exiting: rc = 1 00000100:00100000:3.0:1789050191.633127:0:14396:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff950604701400:14396] 2 exiting: rc = 0 00000020:00010000:0.0:1789050191.633329:0:14390:0:(genops.c:1906:obd_stale_export_get()) Get export ffff95073f2df000: total 0 00010000:00010000:0.0:1789050191.633374:0:14390:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff95073f2df000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1789050191.633410:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950605f06000/0x9df728c939b79b84 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b79b7d expref: 9 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050191.633434:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950605f06e00/0x9df728c939b79c02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b79bfb expref: 8 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050191.633522:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950702c51a00/0x9df728c939b79b92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b79b8b expref: 7 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050191.633536:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073c531a00/0x9df728c939b79bbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b79bb5 expref: 6 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050191.633549:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950702c50200/0x9df728c939b79e78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b79e71 expref: 5 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050191.633562:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950605f06600/0x9df728c939b79a6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b79a65 expref: 4 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050191.633575:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703330600/0x9df728c939b79c2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b79c25 expref: 3 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050191.633612:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703330c00/0x9df728c939b79e86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9df728c939b79e7f expref: 2 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050191.633624:0:14390:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff95073f2df000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1789050191.633638:0:14390:0:(genops.c:885:class_export_put()) final put ffff95073f2df000/eecacad0-cee9-47e6-a4ee-b5aef8a75ff1 00010000:00010000:0.0:1789050191.633647:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050191.633649:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050191.633650:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050191.633673:0:14395:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff95072081aa00:14395] 1 exiting: rc = 0 00000100:00100000:1.0:1789050191.633781:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.633792:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.633800:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.633807:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.633815:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.633832:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.633843:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.633851:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789050191.633938:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95073f2df000/eecacad0-cee9-47e6-a4ee-b5aef8a75ff1 for MGS 00000020:00000080:3.0:1789050191.633982:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95073f2da000 for MGS 00000100:00100000:1.0:1789050191.634016:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634029:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634035:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634041:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634046:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634053:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634059:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634064:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634071:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634077:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634083:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634089:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634094:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634101:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634107:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634113:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634120:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634126:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634132:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634138:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634145:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634151:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634157:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634163:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634169:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634174:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634180:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634186:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634191:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634228:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634236:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634242:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634256:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634262:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634267:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634273:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634277:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634283:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634287:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634293:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634299:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634305:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634311:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634316:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634321:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634327:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634332:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634338:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634345:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634353:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634363:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634388:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634395:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634402:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634408:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050191.634414:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789050191.635624:0:17538:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789050191.635631:0:17538:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1789050191.636715:0:17538:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff950704f42720 - data ffff9507181bae58/ffff950710e7a000 00000020:01000000:1.0:1789050191.637046:0:17538:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95073cfee300 - data ffff950731bdbaf8/ffff950605753000 00000020:00000080:1.0:1789050191.638373:0:17538:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79a42 00000020:00000080:1.0:1789050191.638384:0:17538:0:(genops.c:885:class_export_put()) final put ffff95073cd7f800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789050191.638456:0:17538:0:(tgt_mount.c:187:server_put_mount()) put mount ffff950605aa8800 from MGS, refs=2 00000020:01000004:1.0:1789050191.638461:0:17538:0:(obd_mount.c:710:lustre_put_lsi()) put ffff950605aa8800 2 00000020:01000004:1.0:1789050191.638464:0:17538:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff950605aa8800 from MGS 00000020:00000080:1.0:1789050191.638493:0:17538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789050191.638515:0:17538:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789050191.638518:0:17538:0:(genops.c:885:class_export_put()) final put ffff95073cd7f000/MGS 00000020:00000080:1.0:1789050191.638522:0:17538:0:(genops.c:844:class_export_destroy()) destroying export ffff95073cd7f000/MGS for MGS 00000020:01000000:1.0:1789050191.638530:0:17538:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789050191.638599:0:17538:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789050191.638604:0:17538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789050191.638611:0:17538:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789050191.638618:0:17538:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff95071009b800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789050191.638624:0:17538:0:(genops.c:1552:class_disconnect_exports()) OBD device 10 (ffff950702d98000) has exports, disconnecting them 00000020:00080000:1.0:1789050191.638630:0:17538:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff95071009b800), last request at 1789050117 00000020:00000080:1.0:1789050191.638635:0:17538:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79b30 00000020:00080000:1.0:1789050191.638645:0:17538:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95071009b800): rc 0 00000020:00000080:1.0:1789050191.638650:0:17538:0:(genops.c:885:class_export_put()) final put ffff95071009b800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789050191.638765:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95073cd7f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789050191.639753:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95071009b800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789050191.640271:0:17538:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789050191.640280:0:17538:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789050191.640285:0:17538:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789050191.640292:0:17538:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789050191.640361:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9507060b1000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789050191.640627:0:17538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789050191.640637:0:17538:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789050191.640642:0:17538:0:(genops.c:885:class_export_put()) final put ffff950703777800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789050191.640646:0:17538:0:(genops.c:844:class_export_destroy()) destroying export ffff950703777800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789050191.640652:0:17538:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789050191.640721:0:17538:0:(obd_mount.c:710:lustre_put_lsi()) put ffff950605aa8800 1 00000020:00000080:0.0:1789050191.640727:0:17538:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79a34 00000020:00000080:0.0:1789050191.640734:0:17538:0:(genops.c:885:class_export_put()) final put ffff95073cd78000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789050191.640744:0:17538:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789050191.640752:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95073cd78000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789050191.640762:0:17538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789050191.640767:0:17538:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789050191.640781:0:17538:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff95070345cd40) has no exports 00000020:00000080:0.0:1789050191.659184:0:17538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789050191.659224:0:17538:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789050191.659231:0:17538:0:(genops.c:885:class_export_put()) final put ffff950605aaa000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789050191.659237:0:17538:0:(genops.c:844:class_export_destroy()) destroying export ffff950605aaa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789050191.659244:0:17538:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789050191.659951:0:17538:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff950605aaf800 00000020:01000000:0.0:1789050191.659980:0:17538:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789050191.659985:0:17538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789050191.659991:0:17538:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789050191.659996:0:17538:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff950706400000) has no exports 00000100:00100000:0.0:1789050191.660092:0:16279:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff95073cbe5200:16279] 3 exiting: rc = 0 00000100:00100000:2.0:1789050191.661399:0:14402:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9507035c0000:14402] 1 exiting: rc = 0 00000100:00100000:1.0:1789050191.661405:0:14401:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff950720618a00:14401] 0 exiting: rc = 1 00000100:00100000:2.0:1789050191.661490:0:14403:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9507035c0400:14403] 2 exiting: rc = 0 00000100:00100000:0.0:1789050191.663289:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663302:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663310:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663320:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663329:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663336:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663344:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663357:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663365:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663373:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663381:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663389:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663397:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663404:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663411:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663422:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663432:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663454:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663464:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663474:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663480:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663486:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663511:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663521:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663531:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663537:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663549:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663563:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663570:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663579:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663589:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663600:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663614:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663626:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663636:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663642:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663657:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663667:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663674:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663680:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663686:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663692:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663699:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663704:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663710:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663716:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663722:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663728:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663734:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663740:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663747:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663753:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663764:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663783:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663790:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663803:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663808:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663824:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663831:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663838:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663845:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663851:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663857:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.663863:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050191.675131:0:16631:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff95071eef4a00:16631] 2 exiting: rc = 0 00000100:00100000:0.0:1789050191.675348:0:14405:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff950703877600:14405] 1 exiting: rc = 0 00000100:00100000:1.0:1789050191.675547:0:14404:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9507035c0800:14404] 0 exiting: rc = 1 00000100:00100000:0.0:1789050191.675751:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675760:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675768:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675776:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675782:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675788:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675794:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675800:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675806:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675812:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675818:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675824:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675830:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675836:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675842:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675847:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675853:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675860:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675867:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675884:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675890:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675896:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675902:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675908:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675918:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675924:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675931:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675953:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675959:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675965:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675971:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675976:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675982:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675988:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675993:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.675999:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676005:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676012:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676018:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676028:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676035:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676042:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676049:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676060:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676067:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676074:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676081:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676089:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676096:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676103:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676110:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676117:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676124:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676131:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676137:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676144:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676149:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676156:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676161:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676168:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676174:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676179:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676193:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676409:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.676999:0:14406:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff950710089c00:14406] 0 exiting: rc = 1 00000100:00100000:0.0:1789050191.677079:0:14407:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff950710089200:14407] 1 exiting: rc = 0 00000100:00100000:0.0:1789050191.677136:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677144:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677150:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677157:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677176:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677185:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677192:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677226:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677234:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677240:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677247:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677254:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677260:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677267:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677272:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677278:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677302:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677311:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677318:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677327:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677334:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677340:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677347:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677356:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677363:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677370:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677377:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677385:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677408:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677416:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677423:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677512:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677524:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677531:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677539:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677547:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677555:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677561:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677568:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677574:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677596:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677605:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677611:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677618:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677625:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677631:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677638:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677645:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677654:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677663:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677670:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677679:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677702:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677710:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677716:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677723:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677730:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677737:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677745:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677751:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677759:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677766:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677773:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.677780:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050191.689320:0:14408:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff950710088200:14408] 0 exiting: rc = 1 00000100:00100000:0.0:1789050191.689362:0:14409:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff950710089e00:14409] 1 exiting: rc = 0 00000100:00100000:0.0:1789050191.689678:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689699:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689741:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689747:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689752:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689757:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689763:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689774:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689780:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689785:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689790:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689795:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689801:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689806:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689811:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689816:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689822:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689828:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689834:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689840:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689845:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689851:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689908:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689914:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689920:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689925:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689931:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689937:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689942:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689947:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689952:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689957:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689962:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689968:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689974:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689980:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.689997:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690003:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690009:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690014:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690020:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690025:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690031:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690036:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690042:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690053:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690059:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690110:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690115:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690120:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690126:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690131:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690136:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690141:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690147:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690156:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690162:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690167:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690172:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690178:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690183:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690187:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690193:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.690318:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050191.690828:0:14411:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff950710088400:14411] 1 exiting: rc = 0 00000100:00100000:2.0:1789050191.690993:0:14410:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff950710088a00:14410] 0 exiting: rc = 1 00000100:00100000:0.0:1789050191.691103:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691109:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691115:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691120:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691125:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691130:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691135:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691152:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691157:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691162:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691168:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691173:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691179:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691185:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691190:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691195:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691292:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691299:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691304:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691309:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691315:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691320:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691326:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691332:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691337:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691342:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691348:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691353:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691358:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691364:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691369:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691375:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691380:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691385:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691392:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691397:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691402:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691408:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691414:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691419:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691425:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691430:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691509:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691519:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691527:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691534:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691541:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691547:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691552:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691558:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691563:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691568:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691574:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691580:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691587:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691594:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691599:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691605:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691611:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691616:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691621:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691627:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691632:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.691637:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050191.692033:0:14413:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff950728c89200:14413] 1 exiting: rc = 0 00000100:00100000:1.0:1789050191.692126:0:14412:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff950710088c00:14412] 0 exiting: rc = 1 00000100:00100000:0.0:1789050191.692159:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692165:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692171:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692178:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692184:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692190:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692195:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692549:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692555:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692560:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692566:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692572:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692577:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692593:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692598:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692604:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692609:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692615:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692621:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692626:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692632:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692637:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692643:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692648:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692653:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692659:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692664:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692669:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692674:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692679:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692684:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692689:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692694:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692699:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692705:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692711:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692716:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692721:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692727:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692732:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692740:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692745:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692751:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692757:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692762:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692768:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692774:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692779:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692792:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692797:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692802:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692808:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692813:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692818:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692824:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692829:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692834:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692839:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692844:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692848:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692853:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692858:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692863:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.692868:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050191.694540:0:14414:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff950607dac000:14414] 0 exiting: rc = 1 00000100:00100000:2.0:1789050191.694733:0:14416:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff950607dac600:14416] 2 exiting: rc = 0 00000100:00100000:1.0:1789050191.695035:0:14415:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff950607dad200:14415] 1 exiting: rc = 0 00000100:00100000:0.0:1789050191.695179:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695187:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695193:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695273:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695281:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695287:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695295:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695301:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695308:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695314:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695321:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695327:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695334:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695340:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695347:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695354:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695362:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695368:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695374:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695411:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695418:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695424:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695431:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695436:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695500:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695509:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695516:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695522:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695528:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695533:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695539:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695545:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695550:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695556:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695563:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695570:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695575:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695582:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695588:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695595:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695601:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695608:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695615:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695642:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695650:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695656:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695662:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695668:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695673:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695679:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695686:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695693:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695699:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695705:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695717:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695723:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695729:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695735:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695740:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695747:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695753:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695760:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695767:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050191.695773:0:17538:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789050191.701332:0:17538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789050191.701352:0:17538:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789050191.701359:0:17538:0:(genops.c:885:class_export_put()) final put ffff95072f430000/MDS_uuid 00000020:00000080:1.0:1789050191.701365:0:17538:0:(genops.c:844:class_export_destroy()) destroying export ffff95072f430000/MDS_uuid for MDS 00000020:01000000:1.0:1789050191.701371:0:17538:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789050191.701824:0:17538:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1789050191.759891:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050192.779477:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050193.804111:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789050194.160310:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789050194.160319:0:7634:0:(genops.c:885:class_export_put()) final put ffff950604d71000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789050194.160393:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff950604d71000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789050194.162411:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950604d71800 for lustre-OST0001 00000020:01000004:0.0:1789050194.211750:0:17691:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789050194.221656:0:17691:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789050194.221700:0:17691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530000/0x9df728c939b79bb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79bbc expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050194.221715:0:17691:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530000/0x9df728c939b79bb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79bbc expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050194.221722:0:17691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530000/0x9df728c939b79bb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79bbc expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050194.221729:0:17691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff95073c530000/0x9df728c939b79bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79bbc expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050194.221780:0:17691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789050194.221786:0:17691:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789050194.221808:0:17691:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789050194.221812:0:17691:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789050194.221819:0:17691:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789050194.221824:0:17691:0:(import.c:65:import_set_state_nolock()) ffff9506046d0000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789050194.221830:0:17691:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789050194.221832:0:17691:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789050194.221834:0:17691:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789050194.222766:0:17691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530a00/0x9df728c939b79b8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79b92 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050194.222780:0:17691:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530a00/0x9df728c939b79b8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79b92 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050194.222786:0:17691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530a00/0x9df728c939b79b8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79b92 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050194.222792:0:17691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff95073c530a00/0x9df728c939b79b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79b92 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050194.222924:0:15850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050194.222931:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95073c530000/0x9df728c939b79bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79bbc expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050194.222938:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c530000 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789050194.222942:0:15850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95073c530000/0x9df728c939b79bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79bbc expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050194.222951:0:15850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073c530000/0x9df728c939b79bb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b79bbc expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050194.222958:0:15850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073c530000/0x9df728c939b79bb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b79bbc expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050194.222964:0:15850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789050194.222967:0:15850:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789050194.222970:0:15850:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789050194.223003:0:15850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95073c530000/0x9df728c939b79bb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79bbc expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050194.223026:0:15850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789050194.223099:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1789050194.223118:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95073c530000/0x9df728c939b79bb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79bbc expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050194.223125:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073c530000/0x9df728c939b79bb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79bbc expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050194.223140:0:15850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050194.223143:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95073c530a00/0x9df728c939b79b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79b92 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050194.223148:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c530a00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789050194.223151:0:15850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95073c530a00/0x9df728c939b79b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79b92 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050194.223158:0:15850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073c530a00/0x9df728c939b79b8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b79b92 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050194.223165:0:15850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073c530a00/0x9df728c939b79b8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b79b92 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050194.223171:0:15850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789050194.223173:0:15850:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1789050194.223184:0:15850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95073c530a00/0x9df728c939b79b8b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79b92 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050194.223189:0:15850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050194.223220:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95073c530a00/0x9df728c939b79b8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79b92 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050194.223239:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050194.223240:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050194.223242:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050194.223249:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789050194.223263:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c02b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3283:1875954704164864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050194.223320:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789050194.223412:0:17691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789050194.223418:0:17691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073c530a00/0x9df728c939b79b8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79b92 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050194.223483:0:17691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79e7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79e86 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050194.223492:0:17691:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79e7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79e86 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050194.223499:0:17691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79e7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79e86 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050194.223506:0:17691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79e7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79e86 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050194.223519:0:17691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789050194.223522:0:17691:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1789050194.223530:0:17691:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789050194.223551:0:17691:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789050194.223554:0:17691:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:2.0:1789050194.223565:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050194.223570:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79e7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79e86 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050194.223577:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c531c00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:2.0:1789050194.223580:0:14390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79e7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79e86 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050194.223587:0:14390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79e7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b79e86 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789050194.223594:0:14390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79e7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b79e86 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050194.223599:0:14390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789050194.223601:0:14390:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789050194.223603:0:14390:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789050194.223616:0:14390:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79e7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79e86 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050194.223621:0:14390:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789050194.223632:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79e7f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79e86 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050194.223639:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073c531c00/0x9df728c939b79e7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9df728c939b79e86 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050194.223648:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050194.223650:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050194.223655:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050194.223665:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3283:1875954704164992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050194.223688:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050194.223716:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704164864 00000100:00100000:2.0:1789050194.223722:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704164864 00000100:00100000:2.0:1789050194.223752:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704164992 00000100:00100000:2.0:1789050194.223755:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704164992 00000100:00100000:2.0:1789050194.223771:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789050194.223777:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c028a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3283:x1875954704164864:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789050194.223782:0:14388:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789050194 with bad export cookie 11382611427924089438 00000100:00100000:3.0:1789050194.223802:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789050194.223808:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720824700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3283:x1875954704164992:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789050194.223820:0:14386:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789050194 with bad export cookie 11382611427924089438 00000100:00100000:3.0:1789050194.223874:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720824700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3283:x1875954704164992:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (185us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789050194.223882:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1789050194.223918:0:3283:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789050194.223922:0:3283:0:(import.c:65:import_set_state_nolock()) ffff95072f433000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789050194.223926:0:3283:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.101@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1789050194.223959:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789050194.232376:0:3283:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.101@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789050194.232382:0:3283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789050194.232391:0:3283:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95073c02b800 x1875954704164864/t0(0) o103->MGC192.168.206.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789050210 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050194.232404:0:3283:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff950720826300 x1875954704164992/t0(0) o103->MGC192.168.206.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789050210 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789050194.232414:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789050194.232416:0:3283:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789050194.232418:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789050194.232577:0:3283:0:(import.c:65:import_set_state_nolock()) ffff95072f433000 MGS: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1789050194.232581:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c02b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:0:1875954704164736:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789050194.232582:0:3283:0:(import.c:545:import_select_connection()) MGC192.168.206.101@tcp: connect to NID 0@lo last attempt 353 00000100:00080000:3.0:1789050194.232595:0:3283:0:(import.c:666:import_select_connection()) MGC192.168.206.101@tcp: import ffff95072f433000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:3.0:1789050194.232625:0:3283:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c272680 x1875954704165120/t0(0) o250->MGC192.168.206.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789050194.232660:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c02b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3283:1875954704164864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789050194.232675:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3283:1875954704164992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050194.232736:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c272680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3281:1875954704165120:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1789050194.232778:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875954704165120 offset 0 length 520: 4 00000020:00000080:3.0:1789050194.233288:0:17691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789050194.233299:0:17691:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789050194.233303:0:17691:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff95070345b380) has no exports 00000020:00080000:3.0:1789050194.233343:0:17691:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff95070345b380) has no exports 00000020:01000000:3.0:1789050194.235074:0:17691:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95070f05ac00 - data ffff950731bbe870/ffff950606b95400 00000020:01000000:3.0:1789050194.235254:0:17691:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff950737906a80 - data ffff95070ef6d000/ffff950704460800 00000400:00000100:2.0:1789050194.236809:0:14388:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875954704164864 offset 224 length 224: 4 00000100:00100000:2.0:1789050194.236831:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c028a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3283:x1875954704164864:12345-0@lo:103:ldlm_bl.0 Request processed in 13052us (13510us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789050194.236842:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00100000:10000000:3.0:1789050194.245053:0:17691:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789050194.262144:0:17691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79ba0 00000020:00000080:3.0:1789050194.262155:0:17691:0:(genops.c:885:class_export_put()) final put ffff950607e12800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789050194.262175:0:17691:0:(tgt_mount.c:187:server_put_mount()) put mount ffff950604dbf800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789050194.262179:0:17691:0:(obd_mount.c:710:lustre_put_lsi()) put ffff950604dbf800 2 00000020:01000004:3.0:1789050194.262182:0:17691:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff950604dbf800 from lustre-OST0000 00000020:00000080:3.0:1789050194.262232:0:17691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789050194.262243:0:17691:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789050194.262246:0:17691:0:(genops.c:885:class_export_put()) final put ffff950607e15800/lustre-OST0000_UUID 00000020:00000080:3.0:1789050194.262249:0:17691:0:(genops.c:844:class_export_destroy()) destroying export ffff950607e15800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789050194.262255:0:17691:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789050194.262293:0:17691:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789050194.262297:0:17691:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789050194.262301:0:17691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789050194.262305:0:17691:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789050194.262312:0:17691:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9506046d4000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789050194.262317:0:17691:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff95073d2299c0) has exports, disconnecting them 00000020:00080000:3.0:1789050194.262322:0:17691:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9506046d4000), last request at 1789050128 00000020:00000080:3.0:1789050194.262326:0:17691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79bca 00000020:00080000:3.0:1789050194.262335:0:17691:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9506046d4000): rc 0 00000020:00000080:3.0:1789050194.262339:0:17691:0:(genops.c:885:class_export_put()) final put ffff9506046d4000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789050194.263244:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff950607e12800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789050194.263261:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9506046d4000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789050194.265327:0:17691:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789050194.265335:0:17691:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789050194.265339:0:17691:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789050194.265348:0:17691:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789050194.265542:0:17691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789050194.265551:0:17691:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1789050194.265558:0:17691:0:(obd_mount.c:710:lustre_put_lsi()) put ffff950604dbf800 1 00000020:00000080:0.0:1789050194.265564:0:17691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79b6f 00000020:00000080:0.0:1789050194.265572:0:17691:0:(genops.c:885:class_export_put()) final put ffff950704f53800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789050194.265577:0:17691:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789050194.265581:0:17691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789050194.265585:0:17691:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789050194.265589:0:17691:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff950704ffcd40) has no exports 00000020:00000080:1.0:1789050194.265664:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9506046d0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789050194.265680:0:36:0:(genops.c:885:class_export_put()) final put ffff95073c7e3000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789050194.265682:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95073c7e3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789050194.265687:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789050194.265740:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff950704f53800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789050194.276661:0:17691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789050194.276675:0:17691:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789050194.276681:0:17691:0:(genops.c:885:class_export_put()) final put ffff9507033bf000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789050194.276685:0:17691:0:(genops.c:844:class_export_destroy()) destroying export ffff9507033bf000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789050194.276706:0:17691:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789050194.276826:0:17691:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9507033be000 00000020:02000400:0.0:1789050194.276882:0:17691:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789050194.827734:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789050195.083420:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) eecacad0-cee9-47e6-a4ee-b5aef8a75ff1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789050195.083443:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) eecacad0-cee9-47e6-a4ee-b5aef8a75ff1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789050195.083447:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789050195.083451:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789050195.083464:0:36:0:(import.c:65:import_set_state_nolock()) ffff950702eb1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789050195.083473:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 425 00000100:00080000:3.0:1789050195.083481:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789050195.083497:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff950702eb1800 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:3.0:1789050195.083543:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c272d80 x1875954704165248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789050195.083708:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3281:1875954704165248:0@lo:38:kworker.0 00000400:00000100:0.0:1789050195.083770:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875954704165248 offset 0 length 520: 4 00010000:00010000:2.0:1789050195.852915:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050196.878506:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789050196.926583:0:17841:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789050196.943986:0:17841:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789050196.944064:0:17841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530200/0x9df728c939b79c25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79c2c expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050196.944079:0:17841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530200/0x9df728c939b79c25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79c2c expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050196.944086:0:17841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073c530200/0x9df728c939b79c25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79c2c expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050196.944093:0:17841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff95073c530200/0x9df728c939b79c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79c2c expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050196.944112:0:17841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789050196.944130:0:17841:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789050196.944163:0:17841:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789050196.944173:0:17841:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95073c272d80 x1875954704165248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789050210 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050196.944188:0:17841:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789050196.944194:0:17841:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789050196.944217:0:17841:0:(import.c:65:import_set_state_nolock()) ffff950702eb1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789050196.944222:0:17841:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789050196.944226:0:17841:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95073c272d80 x1875954704165248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789050210 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050196.944233:0:17841:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789050196.944236:0:17841:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00010000:00010000:0.0:1789050196.944275:0:15850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050196.944283:0:15850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff95073c530200/0x9df728c939b79c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79c2c expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050196.944293:0:15850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073c530200 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789050196.944296:0:15850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff95073c530200/0x9df728c939b79c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79c2c expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050196.944306:0:15850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073c530200/0x9df728c939b79c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b79c2c expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050196.944315:0:15850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073c530200/0x9df728c939b79c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b79c2c expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050196.944321:0:15850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789050196.944323:0:15850:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789050196.944325:0:15850:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789050196.944336:0:15850:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95072f433000 00010000:00010000:0.0:1789050196.944340:0:15850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff95073c530200/0x9df728c939b79c25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9df728c939b79c2c expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050196.944346:0:15850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073c530200/0x9df728c939b79c25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9df728c939b79c2c expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050196.944368:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050196.944370:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050196.944371:0:15850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050196.944395:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3281:1875954704165248:0@lo:38:kworker.0 00010000:00010000:2.0:1789050196.946104:0:17841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c51000/0x9df728c939b79bfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79c02 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050196.946121:0:17841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c51000/0x9df728c939b79bfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79c02 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050196.946128:0:17841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c51000/0x9df728c939b79bfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79c02 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050196.946136:0:17841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff950702c51000/0x9df728c939b79bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79c02 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050196.947385:0:17841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050196.947398:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050196.947404:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950702c51000/0x9df728c939b79bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79c02 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050196.947468:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51000 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:2.0:1789050196.947488:0:14390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950702c51000/0x9df728c939b79bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79c02 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050196.947497:0:14390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950702c51000/0x9df728c939b79bfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b79c02 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789050196.947504:0:14390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950702c51000/0x9df728c939b79bfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b79c02 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050196.947509:0:14390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789050196.947511:0:14390:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1789050196.947521:0:14390:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95072f433000 00010000:00010000:2.0:1789050196.947525:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950702c51000/0x9df728c939b79bfb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9df728c939b79c02 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050196.947532:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950702c51000/0x9df728c939b79bfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9df728c939b79c02 expref: -99 pid: 15802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050196.947548:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050196.947550:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050196.947552:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050196.947565:0:17841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703330a00/0x9df728c939b79e71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b79e78 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050196.947574:0:17841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703330a00/0x9df728c939b79e71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b79e78 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050196.947579:0:17841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703330a00/0x9df728c939b79e71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79e78 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050196.947585:0:17841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.101@tcp lock: ffff950703330a00/0x9df728c939b79e71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9df728c939b79e78 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050196.947605:0:17841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789050196.947610:0:17841:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1789050196.947613:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1789050196.947614:0:17841:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:3.0:1789050196.947618:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950703330a00/0x9df728c939b79e71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79e78 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050196.947624:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330a00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:3.0:1789050196.947627:0:14389:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950703330a00/0x9df728c939b79e71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9df728c939b79e78 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050196.947633:0:14389:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950703330a00/0x9df728c939b79e71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b79e78 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789050196.947639:0:14389:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950703330a00/0x9df728c939b79e71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b79e78 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789050196.947643:0:17841:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 10000000:01000000:3.0:1789050196.947644:0:14389:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789050196.947646:0:14389:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00000020:01000000:2.0:1789050196.947647:0:17841:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 10000000:01000000:3.0:1789050196.947648:0:14389:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00000080:2.0:1789050196.947653:0:17841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1789050196.947654:0:14389:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95072f433000 00010000:00010000:3.0:1789050196.947657:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950703330a00/0x9df728c939b79e71 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9df728c939b79e78 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789050196.947658:0:17841:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789050196.947662:0:17841:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff950704ff99c0) has no exports 00010000:00010000:3.0:1789050196.947663:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950703330a00/0x9df728c939b79e71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9df728c939b79e78 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789050196.947685:0:17841:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff950704ff99c0) has no exports 00010000:00010000:3.0:1789050196.947697:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050196.947699:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050196.947700:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789050196.954237:0:17841:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95070f05ae40 - data ffff9507107b11b0/ffff950606b97400 00000020:01000000:3.0:1789050196.957324:0:17841:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9507379069c0 - data ffff950702244d80/ffff950704462000 00100000:10000000:3.0:1789050196.971347:0:17841:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789050197.000356:0:17841:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79c10 00000020:00000080:0.0:1789050197.000365:0:17841:0:(genops.c:885:class_export_put()) final put ffff950607e13800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789050197.000514:0:17841:0:(tgt_mount.c:187:server_put_mount()) put mount ffff950604d74800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789050197.000519:0:17841:0:(obd_mount.c:710:lustre_put_lsi()) put ffff950604d74800 2 00000020:01000004:0.0:1789050197.000521:0:17841:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff950604d74800 from lustre-OST0001 00000020:00000080:1.0:1789050197.000541:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff950607e13800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789050197.000545:0:17841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789050197.000555:0:17841:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789050197.000558:0:17841:0:(genops.c:885:class_export_put()) final put ffff950605ab9800/lustre-OST0001_UUID 00000020:00000080:0.0:1789050197.000561:0:17841:0:(genops.c:844:class_export_destroy()) destroying export ffff950605ab9800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789050197.000569:0:17841:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789050197.000689:0:17841:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import eecacad0-cee9-47e6-a4ee-b5aef8a75ff1->MGS 00010000:00010000:0.0:1789050197.000704:0:17841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073c531200/0x9df728c939b79b7d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b79b84 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050197.000716:0:17841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073c531200/0x9df728c939b79b7d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b79b84 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050197.000826:0:17841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789050197.000829:0:17841:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789050197.000832:0:17841:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789050197.000857:0:17841:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95072f433000 00010000:00010000:0.0:1789050197.000862:0:17841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073c531200/0x9df728c939b79b7d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9df728c939b79b84 expref: -99 pid: 15084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050197.000880:0:17841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff95073c530e00/0x9df728c939b79a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9df728c939b79a6c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050197.000898:0:17841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff95073c530e00/0x9df728c939b79a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9df728c939b79a6c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050197.000903:0:17841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789050197.000905:0:17841:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789050197.000907:0:17841:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789050197.000996:0:17841:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff95072f433000 00010000:00010000:0.0:1789050197.001001:0:17841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff95073c530e00/0x9df728c939b79a65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9df728c939b79a6c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789050197.001022:0:17841:0:(import.c:65:import_set_state_nolock()) ffff95072f433000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789050197.001026:0:17841:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789050197.001029:0:17841:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789050197.001030:0:17841:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789050197.001038:0:17841:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789050197.001047:0:17841:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff95073c272680 x1875954704165120/t0(0) o250->MGC192.168.206.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789050204 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789050197.001060:0:17841:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789050197.001062:0:17841:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:1.0:1789050197.001091:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c272680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:eecacad0-cee9-47e6-a4ee-b5aef8a75ff1:3281:1875954704165120:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:0.0:1789050197.001114:0:17841:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789050197.001120:0:17841:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79a50 00000020:00000080:0.0:1789050197.001124:0:17841:0:(genops.c:885:class_export_put()) final put ffff95072f434000/eecacad0-cee9-47e6-a4ee-b5aef8a75ff1 00000020:01000000:0.0:1789050197.001137:0:17841:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.101@tcp (flags='') 00000020:00000080:0.0:1789050197.001142:0:17841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789050197.001146:0:17841:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.101@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789050197.001150:0:17841:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9507064019c0) has no exports 00000020:00000080:2.0:1789050197.001159:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95072f434000/eecacad0-cee9-47e6-a4ee-b5aef8a75ff1 for MGC192.168.206.101@tcp 10000000:01000000:1.0:1789050197.001534:0:14398:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789050197.001562:0:17841:0:(obd_class.h:676:obd_cleanup_client_import()) MGC192.168.206.101@tcp: client import never connected 00000100:00080000:0.0:1789050197.001565:0:17841:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789050197.001567:0:17841:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789050197.001570:0:17841:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789050197.001579:0:17841:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789050197.001671:0:17841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789050197.001677:0:17841:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.101@tcp (uuid eecacad0-cee9-47e6-a4ee-b5aef8a75ff1) 00000020:01000000:0.0:1789050197.001683:0:17841:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789050197.001686:0:17841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789050197.001694:0:17841:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789050197.001700:0:17841:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff95071009c000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789050197.001705:0:17841:0:(genops.c:1552:class_disconnect_exports()) OBD device 17 (ffff95073f3d8000) has exports, disconnecting them 00000020:00080000:0.0:1789050197.001709:0:17841:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff95071009c000), last request at 1789050142 00000020:00000080:0.0:1789050197.001713:0:17841:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79c3a 00000020:00080000:0.0:1789050197.001879:0:17841:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff95071009c000): rc 0 00000020:00000080:0.0:1789050197.001883:0:17841:0:(genops.c:885:class_export_put()) final put ffff95071009c000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789050197.001966:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff95072f433000 for MGC192.168.206.101@tcp 00000020:00000080:2.0:1789050197.001974:0:36:0:(genops.c:885:class_export_put()) final put ffff95072f435000/eecacad0-cee9-47e6-a4ee-b5aef8a75ff1 00000020:00000080:2.0:1789050197.001977:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95072f435000/eecacad0-cee9-47e6-a4ee-b5aef8a75ff1 for MGC192.168.206.101@tcp 00000020:01000000:2.0:1789050197.001982:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.101@tcp (eecacad0-cee9-47e6-a4ee-b5aef8a75ff1) 00000020:00000080:2.0:1789050197.005839:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95071009c000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789050197.006251:0:17841:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789050197.006256:0:17841:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789050197.006259:0:17841:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789050197.006265:0:17841:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789050197.006312:0:15850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789050197.006837:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:2.0:1789050197.006973:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff950702eb1800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1789050197.007135:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1789050197.007406:0:14384:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff95073cde1400:14384] 0 exiting: rc = 1 00000100:00100000:2.0:1789050197.007580:0:16517:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff95070352cc00:16517] 2 exiting: rc = 0 00000100:00100000:0.0:1789050197.007667:0:14385:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9507033eee00:14385] 1 exiting: rc = 0 00000100:00100000:0.0:1789050197.007757:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.008177:0:16518:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff950605a85c00:16518] 3 exiting: rc = 0 00000100:00100000:2.0:1789050197.008318:0:14388:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9506063b3a00:14388] 2 exiting: rc = 0 00000100:00100000:3.0:1789050197.008642:0:14386:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff95070aa44000:14386] 0 exiting: rc = 1 00000100:00100000:3.0:1789050197.008711:0:14387:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9506063b3e00:14387] 1 exiting: rc = 0 00000100:00100000:0.0:1789050197.008873:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.008881:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.008889:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.008895:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.008908:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.008914:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.008919:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.008924:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.008929:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.008934:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.008939:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.008944:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.008961:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.008966:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.008971:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.008975:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.008980:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.008984:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.008989:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.008994:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009002:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009009:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009017:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009025:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009031:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009042:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009047:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009052:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009058:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009063:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009067:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009073:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009078:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009083:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009090:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009098:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009104:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009111:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009119:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009129:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009134:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009388:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009398:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009403:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009408:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009414:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009419:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009432:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009438:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009443:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009448:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009453:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009458:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009463:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009468:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009474:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009480:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009484:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009489:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009493:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009499:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009504:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009509:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.009514:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789050197.012696:0:17841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789050197.012708:0:17841:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789050197.012713:0:17841:0:(genops.c:885:class_export_put()) final put ffff950604dbd000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789050197.012718:0:17841:0:(genops.c:844:class_export_destroy()) destroying export ffff950604dbd000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789050197.012726:0:17841:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1789050197.012770:0:17841:0:(obd_mount.c:710:lustre_put_lsi()) put ffff950604d74800 1 00000020:00000080:0.0:1789050197.012775:0:17841:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9df728c939b79bf4 00000020:00000080:0.0:1789050197.012781:0:17841:0:(genops.c:885:class_export_put()) final put ffff950605abe000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789050197.012804:0:17841:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789050197.012809:0:17841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789050197.012813:0:17841:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789050197.012892:0:17841:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9507044219c0) has no exports 00000020:00000080:2.0:1789050197.012908:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff950605abe000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789050197.036273:0:17841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789050197.036286:0:17841:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789050197.036291:0:17841:0:(genops.c:885:class_export_put()) final put ffff950604d76800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789050197.036296:0:17841:0:(genops.c:844:class_export_destroy()) destroying export ffff950604d76800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789050197.036305:0:17841:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789050197.036504:0:17841:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff950604d73000 00000020:01000000:3.0:1789050197.036523:0:17841:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789050197.036527:0:17841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789050197.036531:0:17841:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789050197.036535:0:17841:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff950703458000) has no exports 00000020:00000080:3.0:1789050197.036561:0:17841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789050197.036566:0:17841:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789050197.036569:0:17841:0:(genops.c:885:class_export_put()) final put ffff950704f51000/OSS_uuid 00000020:00000080:3.0:1789050197.036571:0:17841:0:(genops.c:844:class_export_destroy()) destroying export ffff950704f51000/OSS_uuid for OSS 00000020:01000000:3.0:1789050197.036580:0:17841:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1789050197.036643:0:15086:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff950607cef400:15086] 0 exiting: rc = 1 00000100:00100000:3.0:1789050197.039091:0:15848:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9507035c0c00:15848] 3 exiting: rc = 0 00000100:00100000:3.0:1789050197.039184:0:15087:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff950607ceea00:15087] 1 exiting: rc = 0 00000100:00080000:3.0:1789050197.039228:0:14397:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789050197.040045:0:16630:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff950605cfc600:16630] 4 exiting: rc = 0 00000100:00100000:2.0:1789050197.040155:0:15088:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff95070341fe00:15088] 2 exiting: rc = 0 00000100:00100000:3.0:1789050197.040548:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040555:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040560:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040565:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040581:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040586:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040590:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040595:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040600:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040605:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040609:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040613:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040618:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040624:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040631:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040637:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040642:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040647:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040652:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040657:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040661:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040666:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040670:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040675:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040680:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040684:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040689:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040694:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040699:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040704:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040712:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040718:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040723:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040727:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040732:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040737:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040742:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040747:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040751:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040764:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040768:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040773:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040779:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040783:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040789:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040793:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040798:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040803:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040809:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040814:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040820:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040825:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040831:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040836:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040851:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040857:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040863:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040877:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040885:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040890:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040896:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040901:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040906:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789050197.040912:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050197.042218:0:15090:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9506010f8200:15090] 1 exiting: rc = 0 00000100:00100000:2.0:1789050197.042442:0:15089:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff95070341f200:15089] 0 exiting: rc = 1 00000100:00100000:0.0:1789050197.042600:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042607:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042612:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042617:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042621:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042633:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042638:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042642:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042647:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042652:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042656:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042660:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042665:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042670:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042675:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042680:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042685:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042690:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042696:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042701:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042706:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042711:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042716:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042721:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042726:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042732:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042737:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042742:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042747:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042752:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042756:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042761:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042766:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042771:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042776:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042784:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042789:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042794:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042799:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042804:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042817:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042822:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042827:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042832:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042838:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042853:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042858:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042862:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042867:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042871:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042875:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042880:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042885:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042890:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042895:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042903:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042910:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042915:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042929:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042934:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042939:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042943:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042948:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.042960:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.044233:0:15091:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff95073c767a00:15091] 0 exiting: rc = 1 00000100:00100000:2.0:1789050197.044483:0:15092:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff95073c767600:15092] 1 exiting: rc = 0 00000100:00100000:2.0:1789050197.044650:0:15093:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff95073c767000:15093] 2 exiting: rc = 0 00000100:00100000:0.0:1789050197.045017:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045025:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045030:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045035:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045041:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045045:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045051:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045072:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045079:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045085:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045090:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045105:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045111:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045116:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045123:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045128:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045134:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045140:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045145:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045151:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045157:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045162:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045168:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045175:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045181:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045186:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045191:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045225:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045233:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045238:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045244:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045264:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045271:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045276:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045282:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045287:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045292:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045297:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045302:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045307:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045312:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045318:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045324:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045330:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045336:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045341:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045354:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045360:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045366:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045371:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045388:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045394:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045400:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045406:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045412:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045551:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045560:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045582:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045589:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045594:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045600:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045605:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045610:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789050197.045621:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050197.052705:0:15095:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff950604d44200:15095] 1 exiting: rc = 0 00000100:00100000:0.0:1789050197.052818:0:15094:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff950604d44a00:15094] 0 exiting: rc = 1 00000100:00100000:2.0:1789050197.052897:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.052905:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.052910:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.052924:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.052929:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.052935:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.052940:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.052945:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.052950:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.052955:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.052960:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.052964:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.052969:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.052974:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.052982:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.052987:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.052992:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.052997:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053001:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053006:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053010:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053015:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053020:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053024:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053029:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053034:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053039:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053043:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053049:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053054:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053058:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053073:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053079:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053084:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053091:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053096:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053101:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053106:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053110:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053115:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053120:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053125:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053130:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053136:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053142:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053146:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053151:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053156:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053160:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053165:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053169:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053174:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053178:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053182:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053187:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053192:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053471:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053480:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053484:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053489:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053494:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053499:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053504:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.053509:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789050197.054698:0:15097:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff950604d45c00:15097] 1 exiting: rc = 0 00000100:00100000:0.0:1789050197.054900:0:15096:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff950604d44c00:15096] 0 exiting: rc = 1 00000100:00100000:2.0:1789050197.055041:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055049:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055064:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055070:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055077:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055083:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055088:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055096:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055102:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055125:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055133:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055139:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055145:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055151:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055156:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055162:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055168:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055174:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055179:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055184:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055189:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055301:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055308:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055315:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055321:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055326:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055332:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055337:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055343:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055350:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055356:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055362:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055367:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055398:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055405:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055410:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055533:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055547:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055553:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055558:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055564:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055569:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055574:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055579:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055585:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055605:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055611:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055617:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055623:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055628:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055635:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055641:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055647:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055653:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055659:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055665:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055670:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055690:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055696:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055703:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055709:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055715:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055721:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789050197.055727:0:17841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789050197.066692:0:17841:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789050212.190095:0:18453:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg601-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789050219.030005:0:18914:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789050219.030010:0:18914:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789050219.030124:0:18914:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95072f422000 00000020:01000004:2.0:1789050219.030139:0:18914:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789050219.030146:0:18914:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789050219.030160:0:18914:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff950704ffb380) 00000020:00000080:2.0:1789050219.030171:0:18914:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789050219.046593:0:18914:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789050219.049096:0:18914:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:3.0:1789050219.049593:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 581: rc = 0 00100000:10000000:3.0:1789050219.049694:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 581: rc = 0 00100000:10000000:3.0:1789050219.049796:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 581: rc = 0 00100000:10000000:3.0:1789050219.049887:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 581: rc = 0 00100000:10000000:3.0:1789050219.050134:0:18914:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789050219.050233:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 581: rc = 0 00100000:10000000:3.0:1789050219.050405:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 581: rc = 0 00100000:10000000:3.0:1789050219.050649:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 583: rc = 0 00100000:10000000:3.0:1789050219.051736:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 401: rc = 0 00100000:10000000:3.0:1789050219.051833:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 401: rc = 0 00100000:10000000:3.0:1789050219.052463:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 769: rc = 0 00100000:10000000:3.0:1789050219.052979:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00100000:10000000:3.0:1789050219.053444:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 769: rc = 0 00100000:10000000:3.0:1789050219.053817:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:3.0:1789050219.054387:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:3.0:1789050219.054661:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 769: rc = 0 00100000:10000000:3.0:1789050219.054912:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 769: rc = 0 00100000:10000000:3.0:1789050219.055152:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:3.0:1789050219.055578:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00100000:10000000:3.0:1789050219.055871:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 769: rc = 0 00100000:10000000:3.0:1789050219.056106:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:3.0:1789050219.056420:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 769: rc = 0 00100000:10000000:3.0:1789050219.056800:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 419: rc = 0 00100000:10000000:3.0:1789050219.057038:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 419: rc = 0 00100000:10000000:3.0:1789050219.057357:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 419: rc = 0 00100000:10000000:3.0:1789050219.057595:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 419: rc = 0 00100000:10000000:3.0:1789050219.057840:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 419: rc = 0 00100000:10000000:3.0:1789050219.058159:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 419: rc = 0 00100000:10000000:3.0:1789050219.058423:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 419: rc = 0 00100000:10000000:3.0:1789050219.058660:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 419: rc = 0 00100000:10000000:3.0:1789050219.059428:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 419: rc = 0 00100000:10000000:3.0:1789050219.059696:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 419: rc = 0 00100000:10000000:3.0:1789050219.059930:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 419: rc = 0 00100000:10000000:3.0:1789050219.060169:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 419: rc = 0 00100000:10000000:3.0:1789050219.060442:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 419: rc = 0 00100000:10000000:3.0:1789050219.060693:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 419: rc = 0 00100000:10000000:3.0:1789050219.060941:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 419: rc = 0 00100000:10000000:3.0:1789050219.061174:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 419: rc = 0 00100000:10000000:3.0:1789050219.061443:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 419: rc = 0 00100000:10000000:3.0:1789050219.061700:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 419: rc = 0 00100000:10000000:3.0:1789050219.061953:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 419: rc = 0 00100000:10000000:3.0:1789050219.064222:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 419: rc = 0 00100000:10000000:3.0:1789050219.064493:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 419: rc = 0 00100000:10000000:3.0:1789050219.064770:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 419: rc = 0 00100000:10000000:3.0:1789050219.065110:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 419: rc = 0 00100000:10000000:3.0:1789050219.065414:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 419: rc = 0 00100000:10000000:3.0:1789050219.065647:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 419: rc = 0 00100000:10000000:3.0:1789050219.065919:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 419: rc = 0 00100000:10000000:3.0:1789050219.066176:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 419: rc = 0 00100000:10000000:3.0:1789050219.066447:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 419: rc = 0 00100000:10000000:3.0:1789050219.066668:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 419: rc = 0 00100000:10000000:3.0:1789050219.067429:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 419: rc = 0 00100000:10000000:3.0:1789050219.067669:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 419: rc = 0 00100000:10000000:3.0:1789050219.067913:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 419: rc = 0 00100000:10000000:3.0:1789050219.068302:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 649: rc = 0 00100000:10000000:3.0:1789050219.068764:0:18914:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1789050219.068922:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 406: rc = 0 00100000:10000000:3.0:1789050219.069109:0:18914:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1789050219.069176:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 406: rc = 0 00100000:10000000:3.0:1789050219.069380:0:18914:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1789050219.069440:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 406: rc = 0 00100000:10000000:3.0:1789050219.069766:0:18914:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1789050219.069837:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 402: rc = 0 00100000:10000000:3.0:1789050219.070221:0:18914:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1789050219.070295:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 402: rc = 0 00100000:10000000:3.0:1789050219.070473:0:18914:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1789050219.070535:0:18914:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 402: rc = 0 00000020:00000080:3.0:1789050219.070798:0:18914:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789050219.070804:0:18914:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789050219.070814:0:18914:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b7a196 00000020:01000004:3.0:1789050219.070821:0:18914:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789050219.070826:0:18914:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789050219.070831:0:18914:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95072f422000 from MGS 00000020:01000004:3.0:1789050219.070835:0:18914:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789050219.070845:0:18914:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9507044219c0) 00000020:00000080:3.0:1789050219.070855:0:18914:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789050219.070904:0:18914:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95072f422000 from MGS, refs=2 00080000:01000000:3.0:1789050219.070908:0:18914:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789050219.070912:0:18914:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b7a1a4 00000100:00100000:3.0:1789050219.070999:0:18914:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789050219.071126:0:18914:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789050219.071132:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789050219.071646:0:18914:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789050219.071652:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789050219.072143:0:18914:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789050219.072425:0:18914:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789050219.072431:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789050219.074918:0:18914:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789050219.074940:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789050219.075943:0:18914:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789050219.075950:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789050219.076819:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050219.076822:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050219.076824:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050219.077145:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050219.077148:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050219.077150:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050219.077754:0:18914:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789050219.087661:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789050219.096398:0:18914:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789050219.096414:0:18914:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789050219.096417:0:18914:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789050219.098135:0:18923:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789050219.098323:0:18914:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789050219.098424:0:18914:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789050219.099155:0:18914:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789050219.099592:0:18914:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789050219.099764:0:18914:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789050219.099770:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789050219.102497:0:18914:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789050219.102513:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789050219.103022:0:18914:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789050219.103029:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789050219.105451:0:18914:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789050219.105471:0:18914:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.101@tcp' 00000020:01000004:3.0:1789050219.105473:0:18914:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789050219.105499:0:18914:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.101@tcp (typ=mgc) 00000020:00000080:3.0:1789050219.105510:0:18914:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.101@tcp (ffff950704423380) 00000020:00000080:3.0:1789050219.105523:0:18914:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789050219.105609:0:18914:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95073cbc2800@MGC192.168.206.101@tcp: add connection 192.168.206.101@tcp at head 00010000:00010000:3.0:1789050219.105768:0:18914:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.101@tcp-0 is initialized 00000040:01000000:3.0:1789050219.105773:0:18914:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.101@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789050219.107742:0:18928:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789050219.110631:0:18930:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789050219.110738:0:18914:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.101@tcp (uuid 7878f230-1e80-42fc-b48c-88e089c8a2b3) 00000020:00000080:0.0:1789050219.110763:0:18914:0:(genops.c:1384:class_connect()) connect: client 7878f230-1e80-42fc-b48c-88e089c8a2b3, cookie 0x9df728c939b7a1b2 00000100:00080000:0.0:1789050219.110774:0:18914:0:(import.c:545:import_select_connection()) MGC192.168.206.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789050219.110785:0:18914:0:(import.c:666:import_select_connection()) MGC192.168.206.101@tcp: import ffff95073cbc2800 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:0.0:1789050219.110817:0:18914:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c02a680 x1875954704165376/t0(0) o250->MGC192.168.206.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789050219.110846:0:18914:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7878f230-1e80-42fc-b48c-88e089c8a2b3->MGS 00000020:01000004:0.0:1789050219.110868:0:18914:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789050219.110873:0:18914:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789050219.110885:0:18914:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9507064019c0) 00000020:00000080:0.0:1789050219.110898:0:18914:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789050219.112682:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c02a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7878f230-1e80-42fc-b48c-88e089c8a2b3:3281:1875954704165376:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789050219.112759:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050219.112828:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704165376 00000100:00100000:1.0:1789050219.112836:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704165376 00000100:00100000:1.0:1789050219.112870:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789050219.112877:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3281:x1875954704165376:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789050219.112901:0:18925:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 7878f230-1e80-42fc-b48c-88e089c8a2b3@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:1.0:1789050219.112936:0:18925:0:(genops.c:1384:class_connect()) connect: client 7878f230-1e80-42fc-b48c-88e089c8a2b3, cookie 0x9df728c939b7a1c0 00000100:00080000:1.0:1789050219.114584:0:18925:0:(import.c:65:import_set_state_nolock()) ffff950606403800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789050219.114664:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+5:3281:x1875954704165376:12345-0@lo:250:mount.lustre.0 Request processed in 1784us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050219.114675:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789050219.114747:0:3281:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789050219.114764:0:3281:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.101@tcp: connect to target with instance 0 00000100:00080000:1.0:1789050219.114772:0:3281:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789050219.114777:0:3281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789050219.114781:0:3281:0:(import.c:65:import_set_state_nolock()) ffff95073cbc2800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789050219.114784:0:3281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789050219.114801:0:3281:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789050219.114807:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c02a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7878f230-1e80-42fc-b48c-88e089c8a2b3:3281:1875954704165376:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789050219.122191:0:18914:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789050219.122702:0:18914:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789050219.122709:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789050219.123426:0:18914:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789050219.123433:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789050219.127242:0:18914:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789050219.127256:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789050219.128019:0:18914:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789050219.128188:0:18914:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789050219.128193:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789050219.128838:0:18914:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789050219.128845:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789050219.166558:0:18914:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789050219.166764:0:18914:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789050219.166770:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789050219.167913:0:18914:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789050219.167922:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789050219.168620:0:18914:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789050219.168778:0:18914:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789050219.168788:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789050219.169193:0:18914:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789050219.169297:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789050219.169663:0:18914:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789050219.169810:0:18914:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789050219.169815:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789050219.170477:0:18914:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789050219.170484:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789050219.171137:0:18914:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789050219.171669:0:18914:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789050219.171675:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789050219.174023:0:18914:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789050219.174036:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789050219.198066:0:18914:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789050219.198378:0:18914:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789050219.198384:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789050219.200612:0:18914:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789050219.200623:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789050219.201783:0:18914:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789050219.201792:0:18914:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789050219.202496:0:18914:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789050219.202517:0:18914:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789050219.202523:0:18914:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789050219.202645:0:18914:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.101@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789050219.202676:0:18914:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.101@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789050219.202680:0:18914:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789050219.202682:0:18914:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789050219.202684:0:18914:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789050219.202685:0:18914:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789050219.202686:0:18914:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789050219.202688:0:18914:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789050219.202689:0:18914:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789050219.202691:0:18914:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789050219.202692:0:18914:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789050219.202694:0:18914:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789050219.202696:0:18914:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789050219.202699:0:18914:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789050219.202700:0:18914:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789050219.202701:0:18914:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789050219.202702:0:18914:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789050219.202704:0:18914:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789050219.202705:0:18914:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789050219.202706:0:18914:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789050219.202712:0:18914:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789050219.202713:0:18914:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789050219.202714:0:18914:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789050219.202749:0:18914:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789050219.202766:0:18914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c517800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704165504:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789050219.202831:0:18914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050219.202878:0:18914:0:(client.c:2716:ptlrpc_set_wait()) set ffff950703419d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789050219.203031:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704165504 00000100:00100000:0.0:1789050219.203038:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704165504 00000100:00100000:0.0:1789050219.203080:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789050219.203089:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+5:18914:x1875954704165504:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789050219.203132:0:18927:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789050219.203135:0:18927:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789050219.203138:0:18927:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789050219.203489:0:18948:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789050219.203866:0:18927:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:0.0:1789050219.204920:0:18949:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789050219.204926:0:18949:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789050219.204929:0:18949:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789050219.204962:0:18949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1789050219.205489:0:18927:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789050219.205497:0:18927:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789050219.211737:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+5:18914:x1875954704165504:12345-0@lo:253:mount.lustre.0 Request processed in 8630us (8887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050219.211755:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789050219.211835:0:18914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c517800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704165504:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789050219.211850:0:18914:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789050219.211853:0:18914:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789050219.211855:0:18914:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789050219.211856:0:18914:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789050219.211858:0:18914:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789050219.211859:0:18914:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789050219.211860:0:18914:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789050219.211861:0:18914:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789050219.211863:0:18914:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789050219.211864:0:18914:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789050219.211866:0:18914:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789050219.211887:0:18914:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95072f422000 from lustre-MDT0000 10000000:01000000:1.0:1789050219.211909:0:18914:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789050219.211912:0:18914:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789050219.211916:0:18914:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff950704423380 10000000:01000000:1.0:1789050219.211920:0:18914:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789050219.211926:0:18914:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff950704423380 from 1 10000000:01000000:1.0:1789050219.211929:0:18914:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789050219.211960:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7a1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.211970:0:18914:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7a1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.211979:0:18914:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7a1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050219.212016:0:18914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c517800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704165632:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789050219.212047:0:18914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050219.212114:0:18914:0:(client.c:2716:ptlrpc_set_wait()) set ffff950701254e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789050219.212157:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704165632 00000100:00100000:2.0:1789050219.212163:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704165632 00000100:00100000:2.0:1789050219.212243:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789050219.212252:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+5:18914:x1875954704165632:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050219.212263:0:18926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050219.212274:0:18926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950702c50200/0x9df728c939b7a1ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7a1c7 expref: -99 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.212293:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950702c50200/0x9df728c939b7a1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7a1c7 expref: 6 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.212303:0:18926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950702c50200/0x9df728c939b7a1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a1c7 expref: 6 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.212312:0:18926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50200, rc 0) 00000100:00100000:2.0:1789050219.212341:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+6:18914:x1875954704165632:12345-0@lo:101:mount.lustre.0 Request processed in 91us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050219.212347:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789050219.212397:0:18914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c517800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704165632:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050219.212418:0:18914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7a1c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a1ce expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.212428:0:18914:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7a1c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7a1ce expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050219.212474:0:18914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c028e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704165760:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050219.212502:0:18914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050219.212579:0:18914:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507054f6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050219.213031:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704165760 00000100:00100000:3.0:1789050219.213037:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704165760 00000100:00100000:3.0:1789050219.213116:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789050219.213125:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+6:18914:x1875954704165760:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050219.213368:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+6:18914:x1875954704165760:12345-0@lo:501:mount.lustre.0 Request processed in 244us (864us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789050219.213377:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789050219.213460:0:18914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c028e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704165760:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789050219.213488:0:18914:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789050219.213498:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7a1c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a1ce expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.213507:0:18914:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7a1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a1ce expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050219.213514:0:18914:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95072f422000 10000000:01000000:0.0:1789050219.213518:0:18914:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789050219.213522:0:18914:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff95072f422000 10000000:01000000:0.0:1789050219.213524:0:18914:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789050219.213528:0:18914:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff95072f422000 from 1 10000000:01000000:0.0:1789050219.213531:0:18914:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789050219.213551:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950605f06000/0x9df728c939b7a1d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.213559:0:18914:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950605f06000/0x9df728c939b7a1d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.213581:0:18914:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950605f06000/0x9df728c939b7a1d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050219.213595:0:18914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c028e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704165888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789050219.213633:0:18914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050219.213882:0:18914:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507054f6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050219.214427:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704165888 00000100:00100000:1.0:1789050219.214433:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704165888 00000100:00100000:3.0:1789050219.217066:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789050219.217084:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+6:18914:x1875954704165888:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050219.217100:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050219.217122:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703330a00/0x9df728c939b7a1dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7a1d5 expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.217147:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703330a00/0x9df728c939b7a1dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7a1d5 expref: 7 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.217158:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703330a00/0x9df728c939b7a1dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a1d5 expref: 7 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.217179:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330a00, rc 0) 00000100:00100000:3.0:1789050219.217341:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+7:18914:x1875954704165888:12345-0@lo:101:mount.lustre.0 Request processed in 263us (3718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050219.217348:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789050219.217708:0:18914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c028e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704165888:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050219.217736:0:18914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950605f06000/0x9df728c939b7a1d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a1dc expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.217746:0:18914:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950605f06000/0x9df728c939b7a1d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7a1dc expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050219.217764:0:18914:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789050219.217780:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950605f06000/0x9df728c939b7a1d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a1dc expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.217788:0:18914:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950605f06000/0x9df728c939b7a1d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a1dc expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050219.217795:0:18914:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789050219.217800:0:18914:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789050219.217806:0:18914:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff95072f422000 10000000:01000000:1.0:1789050219.217809:0:18914:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789050219.217813:0:18914:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789050219.217816:0:18914:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789050219.217841:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0e600/0x9df728c939b7a1e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.217925:0:18914:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073bc0e600/0x9df728c939b7a1e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.217935:0:18914:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073bc0e600/0x9df728c939b7a1e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050219.217955:0:18914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c514a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704166016:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789050219.217989:0:18914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050219.218022:0:18914:0:(client.c:2716:ptlrpc_set_wait()) set ffff950701254d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789050219.218048:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704166016 00000100:00100000:2.0:1789050219.218056:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704166016 00000100:00100000:2.0:1789050219.218139:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789050219.218148:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+7:18914:x1875954704166016:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050219.218157:0:18926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050219.218173:0:18926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950702c51a00/0x9df728c939b7a1ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7a1e3 expref: -99 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.218189:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950702c51a00/0x9df728c939b7a1ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7a1e3 expref: 8 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.218222:0:18926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950702c51a00/0x9df728c939b7a1ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a1e3 expref: 8 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.218230:0:18926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51a00, rc 0) 00000100:00100000:2.0:1789050219.218271:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+8:18914:x1875954704166016:12345-0@lo:101:mount.lustre.0 Request processed in 124us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050219.218278:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789050219.218341:0:18914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c514a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704166016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050219.218353:0:18914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073bc0e600/0x9df728c939b7a1e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a1ea expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.218373:0:18914:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073bc0e600/0x9df728c939b7a1e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7a1ea expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050219.218426:0:18914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c514a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704166144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050219.218451:0:18914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050219.218935:0:18914:0:(client.c:2716:ptlrpc_set_wait()) set ffff950701254d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789050219.219046:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704166144 00000100:00100000:3.0:1789050219.219051:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704166144 00000100:00100000:3.0:1789050219.219074:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789050219.219081:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+8:18914:x1875954704166144:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050219.219446:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+9:18914:x1875954704166144:12345-0@lo:501:mount.lustre.0 Request processed in 364us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050219.219454:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789050219.219539:0:18914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c514a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704166144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050219.219568:0:18914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c514a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704166272:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050219.219605:0:18914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050219.219967:0:18914:0:(client.c:2716:ptlrpc_set_wait()) set ffff950701254d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789050219.220001:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704166272 00000100:00100000:2.0:1789050219.220008:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704166272 00000100:00100000:2.0:1789050219.220043:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789050219.220053:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+9:18914:x1875954704166272:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789050219.220409:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+9:18914:x1875954704166272:12345-0@lo:503:mount.lustre.0 Request processed in 357us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050219.220417:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789050219.220446:0:18914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c514a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704166272:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050219.221059:0:18950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c514a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7878f230-1e80-42fc-b48c-88e089c8a2b3:18950:1875954704166400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789050219.221105:0:18950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050219.221164:0:18950:0:(client.c:2716:ptlrpc_set_wait()) set ffff950701254e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789050219.221361:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704166400 00000100:00100000:0.0:1789050219.221366:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704166400 00000100:00100000:0.0:1789050219.221451:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789050219.221461:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+9:18950:x1875954704166400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050219.221770:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+9:18950:x1875954704166400:12345-0@lo:502:llog_process_th.0 Request processed in 309us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050219.221777:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789050219.222003:0:18950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c514a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7878f230-1e80-42fc-b48c-88e089c8a2b3:18950:1875954704166400:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789050219.222029:0:18950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789050219.222039:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050219.222041:0:18950:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789050219.222046:0:18950:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789050219.222049:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789050219.222063:0:18950:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff95073f3d99c0) 00000020:00000080:1.0:1789050219.222079:0:18950:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789050219.222085:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789050219.222141:0:18950:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789050219.222148:0:18950:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b7a1f8 00000020:00000080:1.0:1789050219.222376:0:18950:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789050219.222381:0:18950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789050219.222385:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050219.222387:0:18950:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789050219.222389:0:18950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789050219.222393:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050219.222394:0:18950:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789050219.222398:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789050219.222404:0:18950:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff95073f3dcd40) 00000020:00000080:1.0:1789050219.222414:0:18950:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789050219.222418:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789050219.222420:0:18950:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789050219.222423:0:18950:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789050219.222429:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789050219.222480:0:18950:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95072f422000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789050219.222492:0:18950:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff95073f3db380) 00000020:00000080:1.0:1789050219.222501:0:18950:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789050219.222539:0:18950:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789050219.222615:0:18950:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9df728c939b7a20d 00000020:00000080:1.0:1789050219.222770:0:18950:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789050219.222777:0:18950:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789050219.222782:0:18950:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9df728c939b7a214 00080000:01000000:1.0:1789050219.222787:0:18950:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789050219.222791:0:18950:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b7a21b 00010000:00010000:3.0:1789050219.270797:0:18950:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789050219.271163:0:18950:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934640 00000001:00080000:3.0:1789050219.271459:0:18950:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789050219.271959:0:18950:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff950704420000) 00000020:00000080:3.0:1789050219.271977:0:18950:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789050219.272049:0:18950:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789050219.272056:0:18950:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b7a229 00000020:00000080:3.0:1789050219.272473:0:18950:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789050219.279062:0:18950:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9df728c939b7a230 00000020:00000080:3.0:1789050219.281702:0:18950:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789050219.281715:0:18950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789050219.281736:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.281738:0:18950:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789050219.281742:0:18950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789050219.281745:0:18950:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1789050219.281746:0:18950:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789050219.281761:0:18950:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789050219.281763:0:18950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789050219.281766:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.281767:0:18950:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789050219.281770:0:18950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789050219.281774:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.281775:0:18950:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789050219.281779:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789050219.281819:0:18950:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789050219.281834:0:18950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789050219.281837:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.281839:0:18950:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789050219.281841:0:18950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789050219.281845:0:18950:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789050219.281848:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050219.281850:0:18950:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789050219.281853:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789050219.281858:0:18950:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.101@tcp to nid 0x20000c0a8ce65 (192.168.206.101@tcp) 00000020:01000000:3.0:1789050219.281882:0:18950:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789050219.281885:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789050219.281899:0:18950:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff950704424d40) 00000020:00000080:3.0:1789050219.281913:0:18950:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789050219.281918:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789050219.281970:0:18950:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789050219.281976:0:18950:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789050219.281982:0:18950:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b7a23e 00010000:00080000:3.0:1789050219.282011:0:18950:0:(ldlm_lib.c:102:import_set_conn()) imp ffff950703cfb000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.101@tcp at head 00010000:00010000:3.0:1789050219.282259:0:18950:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1789050219.282614:0:18950:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789050219.282657:0:18950:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789050219.283521:0:18950:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789050219.283591:0:18950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1789050219.283667:0:18950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1789050219.284188:0:18954:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789050219.284192:0:18954:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789050219.284783:0:18950:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789050219.284794:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789050219.284822:0:18950:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789050219.284838:0:18950:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9df728c939b7a245 00000100:00080000:2.0:1789050219.284848:0:18950:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789050219.284858:0:18950:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff950703cfb000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:2.0:1789050219.284892:0:18950:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff950720825f80 x1875954704166528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789050219.284954:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704166528:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789050219.285002:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954704166528 offset 0 length 520: 4 00000100:00080000:2.0:1789050219.285055:0:18950:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789050219.285120:0:18950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050219.285124:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050219.285126:0:18950:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789050219.285129:0:18950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789050219.285132:0:18950:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789050219.285133:0:18950:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789050219.285135:0:18950:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789050219.285137:0:18950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789050219.285139:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050219.285141:0:18950:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789050219.285143:0:18950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789050219.285147:0:18950:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789050219.285150:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050219.285151:0:18950:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789050219.285154:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789050219.285158:0:18950:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.101@tcp to nid 0x20000c0a8ce65 (192.168.206.101@tcp) 00000020:01000000:2.0:1789050219.285175:0:18950:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789050219.285178:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789050219.285188:0:18950:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff950704ff8000) 00000020:00000080:2.0:1789050219.285223:0:18950:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789050219.285229:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789050219.285289:0:18950:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789050219.285294:0:18950:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789050219.285301:0:18950:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9df728c939b7a253 00010000:00080000:2.0:1789050219.285332:0:18950:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9507039ef000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.101@tcp at head 00010000:00010000:2.0:1789050219.285513:0:18950:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789050219.285665:0:18950:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789050219.285682:0:18950:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789050219.286160:0:18950:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789050219.286245:0:18950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1789050219.286302:0:18950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1789050219.286713:0:18956:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789050219.286717:0:18956:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789050219.287241:0:18950:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789050219.287250:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789050219.287277:0:18950:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789050219.287292:0:18950:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9df728c939b7a25a 00000100:00080000:0.0:1789050219.287299:0:18950:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789050219.287307:0:18950:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9507039ef000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:0.0:1789050219.287334:0:18950:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c029c00 x1875954704166656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789050219.287481:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704166656:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789050219.287535:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954704166656 offset 0 length 520: 4 00000100:00080000:0.0:1789050219.287635:0:18950:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789050219.287742:0:18950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050219.287747:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050219.287748:0:18950:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789050219.287751:0:18950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050219.287762:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050219.287763:0:18950:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789050219.287766:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789050219.287768:0:18950:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789050219.287770:0:18950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050219.287772:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050219.287774:0:18950:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789050219.287776:0:18950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050219.287778:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050219.287779:0:18950:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789050219.287782:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789050219.287810:0:18950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c029500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7878f230-1e80-42fc-b48c-88e089c8a2b3:18950:1875954704166784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050219.287855:0:18950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050219.287876:0:18950:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507034e0180 going to sleep for 11 seconds 00000100:00100000:2.0:1789050219.287958:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704166784 00000100:00100000:2.0:1789050219.287971:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704166784 00000100:00100000:2.0:1789050219.288013:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789050219.288022:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+9:18950:x1875954704166784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789050219.288259:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+9:18950:x1875954704166784:12345-0@lo:502:llog_process_th.0 Request processed in 238us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050219.288267:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789050219.288354:0:18950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c029500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7878f230-1e80-42fc-b48c-88e089c8a2b3:18950:1875954704166784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789050219.288376:0:18950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050219.288381:0:18950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050219.288382:0:18950:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789050219.288386:0:18950:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789050219.288583:0:18914:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1789050219.288605:0:18914:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789050219.288627:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0e600/0x9df728c939b7a1e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a1ea expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.288637:0:18914:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073bc0e600/0x9df728c939b7a1e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a1ea expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050219.288644:0:18914:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95072f422000 from 1 10000000:01000000:2.0:1789050219.288647:0:18914:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789050219.288671:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c51c00/0x9df728c939b7a261 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.288678:0:18914:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950702c51c00/0x9df728c939b7a261 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.288687:0:18914:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950702c51c00/0x9df728c939b7a261 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050219.288700:0:18914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720827480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704166912:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789050219.288740:0:18914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050219.288766:0:18914:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c525540 going to sleep for 11 seconds 00000100:00100000:0.0:1789050219.288810:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704166912 00000100:00100000:0.0:1789050219.288815:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704166912 00000100:00100000:0.0:1789050219.288844:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789050219.288852:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+9:18914:x1875954704166912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050219.288861:0:18925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050219.288873:0:18925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950605f06800/0x9df728c939b7a268 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7a261 expref: -99 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.288892:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950605f06800/0x9df728c939b7a268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7a261 expref: 10 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.288902:0:18925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950605f06800/0x9df728c939b7a268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a261 expref: 10 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.288917:0:18925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06800, rc 0) 00000100:00100000:0.0:1789050219.288946:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+10:18914:x1875954704166912:12345-0@lo:101:mount.lustre.0 Request processed in 95us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050219.288952:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789050219.289034:0:18914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720827480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704166912:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050219.289050:0:18914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950702c51c00/0x9df728c939b7a261 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a268 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.289059:0:18914:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950702c51c00/0x9df728c939b7a261 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7a268 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050219.289658:0:18914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720827480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704167040:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789050219.289693:0:18914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050219.289754:0:18914:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c525540 going to sleep for 11 seconds 00000100:00100000:3.0:1789050219.289926:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704167040 00000100:00100000:3.0:1789050219.289932:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704167040 00000100:00100000:3.0:1789050219.289991:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789050219.290000:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+10:18914:x1875954704167040:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789050219.290013:0:18927:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789050219.290018:0:18927:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789050219.290180:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+10:18914:x1875954704167040:12345-0@lo:256:mount.lustre.0 Request processed in 181us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050219.290188:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789050219.290346:0:18914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720827480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704167040:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789050219.290917:0:18914:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789050219.290976:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c51c00/0x9df728c939b7a261 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a268 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.290987:0:18914:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950702c51c00/0x9df728c939b7a261 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a268 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050219.290995:0:18914:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95072f422000 from 1 10000000:01000000:2.0:1789050219.290997:0:18914:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789050219.291020:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c50600/0x9df728c939b7a26f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.291028:0:18914:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950702c50600/0x9df728c939b7a26f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.291037:0:18914:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950702c50600/0x9df728c939b7a26f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050219.291050:0:18914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720827480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704167168:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789050219.291086:0:18914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050219.291150:0:18914:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c525540 going to sleep for 11 seconds 00000100:00100000:3.0:1789050219.291194:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704167168 00000100:00100000:3.0:1789050219.291255:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704167168 00000100:00100000:3.0:1789050219.291289:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789050219.291296:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+10:18914:x1875954704167168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050219.291305:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050219.291315:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703330400/0x9df728c939b7a276 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7a26f expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.291331:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703330400/0x9df728c939b7a276 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7a26f expref: 11 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.291340:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703330400/0x9df728c939b7a276 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a26f expref: 11 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.291348:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330400, rc 0) 00000100:00100000:3.0:1789050219.291379:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+11:18914:x1875954704167168:12345-0@lo:101:mount.lustre.0 Request processed in 84us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050219.291385:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789050219.291463:0:18914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720827480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704167168:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050219.291475:0:18914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950702c50600/0x9df728c939b7a26f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a276 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.291483:0:18914:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950702c50600/0x9df728c939b7a26f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7a276 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050219.291525:0:18914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720827480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704167296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050219.291548:0:18914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050219.291573:0:18914:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c525540 going to sleep for 11 seconds 00000100:00100000:3.0:1789050219.291624:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704167296 00000100:00100000:3.0:1789050219.291628:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704167296 00000100:00100000:3.0:1789050219.291656:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789050219.291663:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+11:18914:x1875954704167296:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050219.291997:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+11:18914:x1875954704167296:12345-0@lo:501:mount.lustre.0 Request processed in 333us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050219.292004:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789050219.292085:0:18914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720827480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704167296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050219.292108:0:18914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720827480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704167424:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789050219.292140:0:18914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050219.292160:0:18914:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c525540 going to sleep for 11 seconds 00000100:00100000:3.0:1789050219.292229:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704167424 00000100:00100000:3.0:1789050219.292233:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704167424 00000100:00100000:3.0:1789050219.292252:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789050219.292257:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+11:18914:x1875954704167424:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789050219.292371:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+11:18914:x1875954704167424:12345-0@lo:503:mount.lustre.0 Request processed in 113us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050219.292378:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789050219.292452:0:18914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720827480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704167424:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789050219.293182:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720827480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7878f230-1e80-42fc-b48c-88e089c8a2b3:18958:1875954704167552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789050219.293404:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050219.293458:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c525f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789050219.293519:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704167552 00000100:00100000:3.0:1789050219.293525:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704167552 00000100:00100000:3.0:1789050219.293593:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789050219.293601:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+11:18958:x1875954704167552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789050219.293807:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+11:18958:x1875954704167552:12345-0@lo:502:llog_process_th.0 Request processed in 206us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050219.293815:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789050219.293879:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720827480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7878f230-1e80-42fc-b48c-88e089c8a2b3:18958:1875954704167552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789050219.293902:0:18958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050219.293910:0:18958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050219.293912:0:18958:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789050219.293919:0:18958:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95072f422000 00000020:00000080:0.0:1789050219.293921:0:18958:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789050219.293929:0:18958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050219.293931:0:18958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050219.293933:0:18958:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789050219.293935:0:18958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050219.293937:0:18958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050219.293939:0:18958:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789050219.293942:0:18958:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95072f422000 00000020:00000080:0.0:1789050219.293944:0:18958:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789050219.293996:0:18958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050219.293999:0:18958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050219.294000:0:18958:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789050219.294003:0:18958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050219.294005:0:18958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050219.294006:0:18958:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789050219.294010:0:18958:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95072f422000 00000020:00000080:0.0:1789050219.294012:0:18958:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789050219.294043:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c029500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7878f230-1e80-42fc-b48c-88e089c8a2b3:18958:1875954704167680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050219.294074:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050219.297105:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507034e0780 going to sleep for 11 seconds 00000100:00100000:2.0:1789050219.297141:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704167680 00000100:00100000:2.0:1789050219.297148:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704167680 00000100:00100000:2.0:1789050219.297184:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789050219.297192:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+11:18958:x1875954704167680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789050219.297421:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+11:18958:x1875954704167680:12345-0@lo:502:llog_process_th.0 Request processed in 228us (3345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050219.297433:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789050219.300072:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c029500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7878f230-1e80-42fc-b48c-88e089c8a2b3:18958:1875954704167680:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789050219.300109:0:18958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050219.300116:0:18958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050219.300118:0:18958:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789050219.300122:0:18958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789050219.300186:0:18914:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789050219.300216:0:18914:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789050219.300229:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c50600/0x9df728c939b7a26f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a276 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.300241:0:18914:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950702c50600/0x9df728c939b7a26f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a276 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050219.300286:0:18914:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789050219.300288:0:18914:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95072f422000 10000000:01000000:0.0:1789050219.300291:0:18914:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95072f422000 10000000:01000000:0.0:1789050219.300295:0:18914:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789050219.300300:0:18914:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95072f422000 from 1 10000000:01000000:0.0:1789050219.300302:0:18914:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789050219.300331:0:18914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b7a27d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.300339:0:18914:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b7a27d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.300348:0:18914:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b7a27d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050219.300366:0:18914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c029500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704167808:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789050219.300419:0:18914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050219.300443:0:18914:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507034e00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789050219.300596:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704167808 00000100:00100000:1.0:1789050219.300602:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704167808 00000100:00100000:1.0:1789050219.300633:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789050219.300642:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+11:18914:x1875954704167808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050219.300654:0:18926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050219.300667:0:18926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073bc0f200/0x9df728c939b7a284 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7a27d expref: -99 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.300687:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bc0f200/0x9df728c939b7a284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7a27d expref: 12 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.300697:0:18926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073bc0f200/0x9df728c939b7a284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a27d expref: 12 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.300705:0:18926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bc0f200, rc 0) 00000100:00100000:1.0:1789050219.300751:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:18914:x1875954704167808:12345-0@lo:101:mount.lustre.0 Request processed in 110us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050219.300757:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789050219.303487:0:18914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c029500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704167808:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050219.303514:0:18914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b7a27d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a284 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050219.303526:0:18914:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b7a27d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7a284 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050219.303592:0:18914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c029500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704167936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050219.303640:0:18914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050219.303677:0:18914:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507034e00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050219.303745:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704167936 00000100:00100000:3.0:1789050219.303751:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704167936 00000100:00100000:3.0:1789050219.303788:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789050219.303804:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:18914:x1875954704167936:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050219.304069:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:18914:x1875954704167936:12345-0@lo:501:mount.lustre.0 Request processed in 265us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050219.304077:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789050219.304129:0:18914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c029500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704167936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050219.304153:0:18914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c029500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704168064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789050219.304185:0:18914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050219.304346:0:18914:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507034e00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050219.304423:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704168064 00000100:00100000:3.0:1789050219.304428:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704168064 00000100:00100000:3.0:1789050219.304445:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789050219.304451:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:18914:x1875954704168064:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789050219.304616:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:18914:x1875954704168064:12345-0@lo:503:mount.lustre.0 Request processed in 164us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050219.304623:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789050219.312864:0:18914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c029500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704168064:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789050219.318593:0:18963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c273800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7878f230-1e80-42fc-b48c-88e089c8a2b3:18963:1875954704168192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789050219.318684:0:18963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050219.318739:0:18963:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507035a8840 going to sleep for 11 seconds 00000100:00100000:0.0:1789050219.318789:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704168192 00000100:00100000:0.0:1789050219.318796:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704168192 00000100:00100000:0.0:1789050219.318844:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789050219.318853:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:18963:x1875954704168192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050219.319083:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:18963:x1875954704168192:12345-0@lo:502:llog_process_th.0 Request processed in 230us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050219.319091:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789050219.319182:0:18963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c273800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7878f230-1e80-42fc-b48c-88e089c8a2b3:18963:1875954704168192:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789050219.319268:0:18963:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789050219.319283:0:18963:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff950703458000) 00000020:00000080:3.0:1789050219.319302:0:18963:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1789050219.319370:0:18963:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95072f422000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789050219.319375:0:18963:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95072f422000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789050219.319377:0:18963:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95072f422000 4 00010000:00080000:3.0:1789050219.319404:0:18963:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9507207f6000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.101@tcp at head 00010000:00010000:3.0:1789050219.321098:0:18963:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1789050219.321319:0:18963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789050219.321351:0:18963:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789050219.321364:0:18963:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9df728c939b7a292 00000100:00080000:3.0:1789050219.321373:0:18963:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789050219.321389:0:18963:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9507207f6000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:3.0:1789050219.321420:0:18963:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c273800 x1875954704168320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789050219.321439:0:18963:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789050219.321666:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875954704168320:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789050219.321737:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050219.327050:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704168320 00000100:00100000:3.0:1789050219.327064:0:18932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704168320 00000100:00100000:3.0:1789050219.327109:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789050219.327117:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3281:x1875954704168320:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789050219.327231:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3281:x1875954704168320:12345-0@lo:38:llog_process_th.0 Request processed in 112us (5492us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789050219.327238:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789050219.327563:0:18963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c272680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7878f230-1e80-42fc-b48c-88e089c8a2b3:18963:1875954704168448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789050219.327611:0:18963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050219.327677:0:18963:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507035a8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789050219.327952:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789050219.327959:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9507207f6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789050219.327963:0:3281:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789050219.327967:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875954704168320:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789050219.328019:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704168448 00000100:00100000:0.0:1789050219.328030:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704168448 00000100:00100000:0.0:1789050219.328094:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789050219.328102:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:18963:x1875954704168448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789050219.328341:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:18963:x1875954704168448:12345-0@lo:502:llog_process_th.0 Request processed in 240us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050219.328348:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789050219.328591:0:18963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c272680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7878f230-1e80-42fc-b48c-88e089c8a2b3:18963:1875954704168448:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789050219.328616:0:18963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789050219.328779:0:18914:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789050219.328800:0:18914:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789050219.328815:0:18914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b7a27d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a284 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.328825:0:18914:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950605f07600/0x9df728c939b7a27d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a284 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789050219.328865:0:18914:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789050219.328867:0:18914:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789050219.328869:0:18914:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789050219.328870:0:18914:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789050219.328871:0:18914:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789050219.328873:0:18914:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789050219.328874:0:18914:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789050219.328875:0:18914:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789050219.328877:0:18914:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789050219.328878:0:18914:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789050219.328881:0:18914:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789050219.328883:0:18914:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789050219.328884:0:18914:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789050219.328885:0:18914:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789050219.328886:0:18914:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789050219.328887:0:18914:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789050219.328888:0:18914:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789050219.328889:0:18914:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789050219.328890:0:18914:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789050219.328894:0:18914:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789050219.328895:0:18914:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789050219.328909:0:18914:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789050219.328920:0:18914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704168576:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789050219.328962:0:18914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050219.329027:0:18914:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606cd4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789050219.329071:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704168576 00000100:00100000:0.0:1789050219.329076:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704168576 00000100:00100000:1.0:1789050219.329161:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789050219.329169:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:18914:x1875954704168576:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789050219.329188:0:18926:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789050219.329219:0:18926:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789050219.351793:0:18926:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789050219.351806:0:18926:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789050219.351846:0:18948:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789050219.351850:0:18948:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789050219.351869:0:18948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff950703331c00/0x9df728c939b7a299 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.351886:0:18948:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950605f06800/0x9df728c939b7a268 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a261 expref: 12 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.351895:0:18948:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff950703331c00/0x9df728c939b7a299 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.351945:0:18948:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950605f06800/0x9df728c939b7a268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b7a261 expref: 12 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.351958:0:18948:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff950605f06800/0x9df728c939b7a268 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b7a261 expref: 12 pid: 18925 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050219.351971:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c272680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18948:1875954704168704:0@lo:104: 00000100:00100000:3.0:1789050219.352029:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050219.352062:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507035a8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789050219.352522:0:18915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704168704 00000100:00100000:1.0:1789050219.352530:0:18915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704168704 00000100:00100000:1.0:1789050219.352580:0:18915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789050219.352589:0:18915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c272d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7878f230-1e80-42fc-b48c-88e089c8a2b3+3:18948:x1875954704168704:12345-0@lo:104: 00010000:00010000:1.0:1789050219.352602:0:18915:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950702c51c00/0x9df728c939b7a261 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7a268 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.352658:0:18915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789050219.352664:0:18915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c272d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7878f230-1e80-42fc-b48c-88e089c8a2b3+3:18948:x1875954704168704:12345-0@lo:104: Request processed in 77us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050219.352671:0:18915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789050219.352692:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050219.352698:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950702c51c00/0x9df728c939b7a261 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7a268 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.352705:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51c00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:1.0:1789050219.352709:0:18921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950702c51c00/0x9df728c939b7a261 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b7a268 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.352717:0:18921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950702c51c00/0x9df728c939b7a261 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b7a268 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050219.352747:0:18921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950702c51c00/0x9df728c939b7a261 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b7a268 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050219.352753:0:18921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789050219.352780:0:18921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950702c51c00/0x9df728c939b7a261 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a268 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.352787:0:18921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789050219.352806:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950702c51c00/0x9df728c939b7a261 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a268 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.352814:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950702c51c00/0x9df728c939b7a261 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a268 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050219.352828:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050219.352830:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050219.352831:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050219.352860:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7878f230-1e80-42fc-b48c-88e089c8a2b3:3284:1875954704168832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789050219.352889:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050219.352973:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704168832 00000100:00100000:2.0:1789050219.352978:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704168832 00010000:00010000:2.0:1789050219.352996:0:18917:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950605f06800/0x9df728c939b7a268 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7a261 expref: 13 pid: 18925 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050219.353027:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789050219.353035:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7878f230-1e80-42fc-b48c-88e089c8a2b3+13:3284:x1875954704168832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789050219.353045:0:18917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050219.353050:0:18917:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950605f06800/0x9df728c939b7a268 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7a261 expref: 13 pid: 18925 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.353060:0:18917:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950605f06800/0x9df728c939b7a268 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b7a261 expref: 13 pid: 18925 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.353075:0:18917:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff950703331c00/0x9df728c939b7a299 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.353083:0:18917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703331c00/0x9df728c939b7a299 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789050219.353096:0:18917:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001246588s 00010000:00010000:2.0:1789050219.353100:0:18917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950703331c00/0x9df728c939b7a299 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.353107:0:18917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950703331c00/0x9df728c939b7a299 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.353113:0:18917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff950703331c00/0x9df728c939b7a299 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.353129:0:18917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff950703331c00/0x9df728c939b7a299 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.353135:0:18917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050219.353139:0:18917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff950703331c00/0x9df728c939b7a299 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.353147:0:18917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff950703331c00/0x9df728c939b7a299 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.353156:0:18917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff950703331c00/0x9df728c939b7a299 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050219.353166:0:18917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050219.353226:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7878f230-1e80-42fc-b48c-88e089c8a2b3+13:3284:x1875954704168832:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050219.353233:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789050219.353266:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7878f230-1e80-42fc-b48c-88e089c8a2b3:3284:1875954704168832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789050219.353489:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950605f06800/0x9df728c939b7a268 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b7a261 expref: 12 pid: 18925 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050219.353506:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c272680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18948:1875954704168704:0@lo:104: 00010000:00010000:3.0:1789050219.353519:0:18948:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff950703331c00/0x9df728c939b7a299 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.353527:0:18948:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff950703331c00/0x9df728c939b7a299 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.353533:0:18948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff950703331c00/0x9df728c939b7a299 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050219.353539:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703331c00/0x9df728c939b7a299 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050219.362644:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+11:18914:x1875954704168576:12345-0@lo:253:mount.lustre.0 Request processed in 33469us (33674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050219.362657:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789050219.362751:0:18914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:18914:1875954704168576:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789050219.362767:0:18914:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789050219.362770:0:18914:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789050219.362771:0:18914:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789050219.362772:0:18914:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789050219.362773:0:18914:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789050219.362774:0:18914:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789050219.362775:0:18914:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789050219.362777:0:18914:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789050219.362778:0:18914:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789050219.362779:0:18914:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789050219.362789:0:18914:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789050219.362804:0:18914:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789050219.370633:0:18914:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789050219.370815:0:18914:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789050219.371097:0:18914:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789050219.371282:0:18914:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789050219.372559:0:18914:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789050219.372740:0:18914:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789050219.374698:0:18914:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789050219.374927:0:18914:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789050219.375192:0:18914:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789050219.375704:0:18914:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789050219.376069:0:18914:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1789050219.376403:0:18914:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1789050219.398380:0:18914:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967535 00000040:01000000:0.0:1789050219.398871:0:18914:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789050219.399118:0:18969:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967535 00000020:00080000:2.0:1789050219.399122:0:18969:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967535 00000040:01000000:1.0:1789050219.399215:0:18970:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789050219.399280:0:18970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789050219.401424:0:18970:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789050219.401502:0:18970:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789050219.401506:0:18970:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1789050219.404309:0:18914:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789050219.404442:0:18914:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789050219.405155:0:18914:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789050219.405163:0:18914:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789050219.405298:0:18914:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789050219.406992:0:18914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789050219.408166:0:18914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789050219.408230:0:18914:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789050219.409462:0:18914:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1789050219.412677:0:18914:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:1.0:1789050219.419503:0:18914:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1789050219.451166:0:18914:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789050219.451244:0:18914:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa435c18d7988 00100000:10000000:0.0:1789050219.451253:0:18914:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789050219.453435:0:18914:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789050219.453451:0:18914:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789050219.453475:0:18914:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1789050219.453493:0:18914:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789050220.107476:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789050220.363411:0:18964:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789050220.363420:0:18964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789050220.364755:0:18964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789050220.364766:0:18964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:2.0:1789050220.427694:0:18930:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789050220.427702:0:18930:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95072f422000 from 9 10000000:01000000:2.0:1789050220.427708:0:18930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789050220.427760:0:18930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b7a2a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050220.427771:0:18930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b7a2a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050220.427800:0:18930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b7a2a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050220.427825:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704168960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789050220.427886:0:18930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050220.427942:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c5253c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050220.430414:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704168960 00000100:00100000:3.0:1789050220.430426:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704168960 00000100:00100000:3.0:1789050220.430475:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789050220.430485:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+11:18930:x1875954704168960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050220.430499:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050220.430518:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703331c00/0x9df728c939b7a2a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7a2a0 expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050220.430544:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703331c00/0x9df728c939b7a2a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7a2a0 expref: 12 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050220.430555:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703331c00/0x9df728c939b7a2a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a2a0 expref: 12 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050220.430564:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331c00, rc 0) 00000100:00100000:3.0:1789050220.430631:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:18930:x1875954704168960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (2744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050220.430638:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789050220.432096:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704168960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050220.432120:0:18930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b7a2a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a2a7 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050220.432132:0:18930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b7a2a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7a2a7 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050220.432250:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704169088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789050220.432314:0:18930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050220.432355:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073c5253c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050220.432604:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704169088 00000100:00100000:3.0:1789050220.432610:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704169088 00000100:00100000:3.0:1789050220.432648:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789050220.432658:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:18930:x1875954704169088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789050220.432674:0:18926:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789050220.432690:0:18926:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789050220.432693:0:18926:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1789050220.432799:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:18930:x1875954704169088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050220.432807:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789050220.432890:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704169088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789050220.432933:0:18930:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789050220.432941:0:18930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b7a2a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a2a7 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050220.432951:0:18930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b7a2a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a2a7 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050221.131846:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789050221.387497:0:18964:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789050221.387506:0:18964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789050221.387539:0:18964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789050221.387791:0:18964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789050222.156194:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050223.179679:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789050223.565473:0:19213:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg601-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789050224.203724:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789050224.780479:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789050224.780488:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789050224.780491:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789050224.780494:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789050224.780497:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789050224.780501:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789050224.780505:0:8:0:(import.c:65:import_set_state_nolock()) ffff9507207f6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789050224.780531:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9507207f6000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:0.0:1789050224.780558:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c028a80 x1875954704169344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789050224.780584:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789050224.780597:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7878f230-1e80-42fc-b48c-88e089c8a2b3:3284:1875954704169216:0@lo:400:kworker.0 00000100:00100000:0.0:1789050224.780699:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050224.780765:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704169216 00000100:00100000:0.0:1789050224.780774:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704169216 00000100:00100000:3.0:1789050224.780795:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875954704169344:0@lo:38:kworker.0 00000100:00100000:3.0:1789050224.780835:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050224.780943:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789050224.780954:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:3284:x1875954704169216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050224.781026:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:3284:x1875954704169216:12345-0@lo:400:kworker.0 Request processed in 74us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050224.781033:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789050224.781056:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7878f230-1e80-42fc-b48c-88e089c8a2b3:3284:1875954704169216:0@lo:400:kworker.0 00000100:00100000:2.0:1789050224.781173:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704169344 00000100:00100000:2.0:1789050224.781178:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704169344 00000100:00100000:3.0:1789050224.781964:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789050224.781973:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3281:x1875954704169344:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789050224.782004:0:18932:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:3.0:1789050224.782049:0:18932:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9df728c939b7a2ae 00000004:00100000:3.0:1789050224.782067:0:18932:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789050224.782229:0:18932:0:(import.c:65:import_set_state_nolock()) ffff95073cbc1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789050224.782300:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875954704169344:12345-0@lo:38:kworker.0 Request processed in 325us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050224.782307:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789050224.785218:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95073c028a80 x1875954704169344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789050234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789050224.785245:0:3281:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789050224.785256:0:3281:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789050224.785262:0:3281:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789050224.785266:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9507207f6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789050224.785274:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875954704169344:0@lo:38:kworker.0 00010000:00010000:2.0:1789050225.228236:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050226.253010:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789050226.675967:0:19363:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8e71f5d0 20000000:00000080:1.0:1789050226.675992:0:19363:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95072fdbc400 uarg=0000000000000000 20000000:01000000:1.0:1789050226.676036:0:19363:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789050226.676045:0:19363:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789050226.676051:0:19363:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789050226.676982:0:19364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1789050226.677183:0:19363:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789050226.695133:0:19363:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789050226.695165:0:19363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95073bc0ec00/0x9df728c939b7a2b5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050226.695196:0:19363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950703330400/0x9df728c939b7a276 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a26f expref: 11 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050226.695241:0:19363:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95073bc0ec00/0x9df728c939b7a2b5 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050226.695297:0:19363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950703330400/0x9df728c939b7a276 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b7a26f expref: 11 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050226.695319:0:19363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff950703330400/0x9df728c939b7a276 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b7a26f expref: 11 pid: 18927 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050226.695335:0:19363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19363:1875954704169472:0@lo:104: 00000100:00100000:1.0:1789050226.695392:0:19363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050226.695440:0:19363:0:(client.c:2716:ptlrpc_set_wait()) set ffff950720aa9780 going to sleep for 11 seconds 00000100:00100000:2.0:1789050226.696575:0:18916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704169472 00000100:00100000:2.0:1789050226.696585:0:18916:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704169472 00000100:00100000:2.0:1789050226.696637:0:18916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789050226.696647:0:18916:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c516a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7878f230-1e80-42fc-b48c-88e089c8a2b3+3:19363:x1875954704169472:12345-0@lo:104: 00010000:00010000:2.0:1789050226.696661:0:18916:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950702c50600/0x9df728c939b7a26f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7a276 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050226.696764:0:18916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789050226.696770:0:18916:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c516a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7878f230-1e80-42fc-b48c-88e089c8a2b3+3:19363:x1875954704169472:12345-0@lo:104: Request processed in 125us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050226.696778:0:18916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789050226.696883:0:19363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19363:1875954704169472:0@lo:104: 00010000:00010000:3.0:1789050226.696915:0:19363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95073bc0ec00/0x9df728c939b7a2b5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050226.697023:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050226.697031:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950702c50600/0x9df728c939b7a26f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7a276 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050226.697037:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50600 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789050226.697041:0:18921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950702c50600/0x9df728c939b7a26f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b7a276 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050226.697070:0:18921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950702c50600/0x9df728c939b7a26f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b7a276 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050226.697077:0:18921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950702c50600/0x9df728c939b7a26f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b7a276 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050226.697083:0:18921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789050226.697116:0:18921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950702c50600/0x9df728c939b7a26f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a276 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050226.697122:0:18921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050226.697148:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950702c50600/0x9df728c939b7a26f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a276 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050226.697155:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950702c50600/0x9df728c939b7a26f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a276 expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050226.697170:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050226.697172:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050226.697173:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050226.697191:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789050226.697232:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7878f230-1e80-42fc-b48c-88e089c8a2b3:3283:1875954704169600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050226.697269:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050226.697496:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704169600 00000100:00100000:2.0:1789050226.697502:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704169600 00010000:00010000:2.0:1789050226.697523:0:18917:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950703330400/0x9df728c939b7a276 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7a26f expref: 12 pid: 18927 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050226.697552:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789050226.697559:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:3283:x1875954704169600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789050226.697569:0:18917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050226.697573:0:18917:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950703330400/0x9df728c939b7a276 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7a26f expref: 12 pid: 18927 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050226.697582:0:18917:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950703330400/0x9df728c939b7a276 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b7a26f expref: 12 pid: 18927 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050226.697596:0:18917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703330400/0x9df728c939b7a276 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b7a26f expref: 12 pid: 18927 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050226.697618:0:18917:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95073bc0ec00/0x9df728c939b7a2b5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050226.697626:0:18917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bc0ec00/0x9df728c939b7a2b5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050226.697639:0:18917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95073bc0ec00/0x9df728c939b7a2b5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050226.697645:0:18917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95073bc0ec00/0x9df728c939b7a2b5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050226.697651:0:18917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95073bc0ec00/0x9df728c939b7a2b5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050226.697657:0:18917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95073bc0ec00/0x9df728c939b7a2b5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050226.697662:0:18917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bc0ec00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050226.697665:0:18917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95073bc0ec00/0x9df728c939b7a2b5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050226.697672:0:18917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95073bc0ec00/0x9df728c939b7a2b5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050226.705462:0:19363:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95073bc0ec00/0x9df728c939b7a2b5 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050226.705502:0:19363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95073bc0ec00/0x9df728c939b7a2b5 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050226.709444:0:18917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95073bc0ec00/0x9df728c939b7a2b5 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050226.709462:0:18917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bc0ec00/0x9df728c939b7a2b5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050226.709572:0:18917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050226.709654:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7878f230-1e80-42fc-b48c-88e089c8a2b3+11:3283:x1875954704169600:12345-0@lo:103:ldlm_bl.0 Request processed in 12092us (12382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050226.709665:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789050226.709732:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7878f230-1e80-42fc-b48c-88e089c8a2b3:3283:1875954704169600:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789050227.277650:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050228.299458:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789050228.619312:0:18930:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789050228.619317:0:18930:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95072f422000 from 10 10000000:01000000:2.0:1789050228.619322:0:18930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789050228.619363:0:18930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c50000/0x9df728c939b7a2bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050228.619374:0:18930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950702c50000/0x9df728c939b7a2bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050228.619386:0:18930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950702c50000/0x9df728c939b7a2bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050228.619409:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704169728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789050228.619472:0:18930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050228.619569:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff950720aa9180 going to sleep for 11 seconds 00000100:00100000:1.0:1789050228.620950:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704169728 00000100:00100000:1.0:1789050228.620961:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704169728 00000100:00100000:1.0:1789050228.621021:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789050228.621032:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+11:18930:x1875954704169728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050228.621046:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050228.621072:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95073bc0f800/0x9df728c939b7a2c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7a2bc expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050228.621098:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95073bc0f800/0x9df728c939b7a2c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7a2bc expref: 12 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050228.621109:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95073bc0f800/0x9df728c939b7a2c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a2bc expref: 12 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050228.621117:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95073bc0f800, rc 0) 00000100:00100000:1.0:1789050228.621173:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:18930:x1875954704169728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050228.621193:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789050228.621290:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704169728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050228.621309:0:18930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950702c50000/0x9df728c939b7a2bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a2c3 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050228.621319:0:18930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950702c50000/0x9df728c939b7a2bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7a2c3 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050228.621393:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704169856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050228.621432:0:18930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050228.621461:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff950720aa9180 going to sleep for 11 seconds 00000100:00100000:3.0:1789050228.621512:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704169856 00000100:00100000:3.0:1789050228.621517:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704169856 00000100:00100000:3.0:1789050228.621541:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789050228.621548:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:18930:x1875954704169856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050228.621805:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:18930:x1875954704169856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050228.621812:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789050228.621838:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704169856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789050228.621867:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704169984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789050228.624560:0:18930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050228.624611:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507032ea0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050228.624677:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704169984 00000100:00100000:2.0:1789050228.624685:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704169984 00000100:00100000:2.0:1789050228.624733:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789050228.624742:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:18930:x1875954704169984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050228.624941:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:18930:x1875954704169984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050228.624949:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789050228.627658:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704169984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789050228.628849:0:19435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789050228.629050:0:18930:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789050228.629145:0:18930:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789050228.629156:0:18930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c50000/0x9df728c939b7a2bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a2c3 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050228.629166:0:18930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950702c50000/0x9df728c939b7a2bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a2c3 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050229.331787:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789050229.899338:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789050229.899344:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789050229.899347:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789050229.899350:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789050229.899392:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050229.899412:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7878f230-1e80-42fc-b48c-88e089c8a2b3:3282:1875954704170112:0@lo:400:kworker.0 00000100:00100000:0.0:1789050229.899478:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050229.899527:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c02aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875954704170240:0@lo:400:kworker.0 00000100:00100000:0.0:1789050229.899554:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050229.899588:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704170112 00000100:00100000:0.0:1789050229.899595:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704170112 00000100:00100000:0.0:1789050229.899639:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789050229.899647:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:3282:x1875954704170112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050229.899711:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:3282:x1875954704170112:12345-0@lo:400:kworker.0 Request processed in 64us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050229.899719:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789050229.899762:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7878f230-1e80-42fc-b48c-88e089c8a2b3:3282:1875954704170112:0@lo:400:kworker.0 00000100:00100000:2.0:1789050229.899990:0:3281:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789050219/real 1789050219] req@ffff95073c029c00 x1875954704166656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050229 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050229.900009:0:3281:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95073c029c00 x1875954704166656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050229 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050229.900018:0:3281:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789050219/real 1789050219] req@ffff950720825f80 x1875954704166528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050229 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050229.900028:0:3281:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff950720825f80 x1875954704166528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050229 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789050229.900039:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9507039ef000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789050229.900058:0:3281:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789050229.900061:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704166656:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789050229.900066:0:3281:0:(import.c:65:import_set_state_nolock()) ffff950703cfb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789050229.900080:0:3281:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789050229.900083:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704166528:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1789050229.900115:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704170240 00000100:00100000:2.0:1789050229.900120:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704170240 00000100:00100000:2.0:1789050229.900149:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789050229.900156:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875954704170240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050229.900221:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875954704170240:12345-0@lo:400:kworker.0 Request processed in 42us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050229.900227:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789050229.900384:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789050229.900389:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789050229.900392:0:8:0:(import.c:65:import_set_state_nolock()) ffff950703cfb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789050229.900396:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:3.0:1789050229.900400:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789050229.900408:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff950703cfb000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:3.0:1789050229.900430:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c270700 x1875954704170368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789050229.900445:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789050229.900448:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789050229.900450:0:8:0:(import.c:65:import_set_state_nolock()) ffff9507039ef000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789050229.900453:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:3.0:1789050229.900455:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789050229.900467:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9507039ef000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:3.0:1789050229.900480:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c273b80 x1875954704170496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:2.0:1789050229.901081:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95073c02aa00 x1875954704170240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050229.901094:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c02aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875954704170240:0@lo:400:kworker.0 00000100:00100000:2.0:1789050229.901115:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704170368:0@lo:8:kworker.0 00000400:00000100:2.0:1789050229.901147:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954704170368 offset 0 length 520: 4 00000100:00100000:2.0:1789050229.901171:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704170496:0@lo:8:kworker.0 00000400:00000100:2.0:1789050229.901188:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954704170496 offset 0 length 520: 4 00010000:00010000:0.0:1789050230.348434:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050231.371578:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789050231.636929:0:18964:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789050231.636937:0:18964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789050231.638868:0:18964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1789050231.638939:0:18964:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789050231.638970:0:18964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000020:01000004:1.0:1789050231.689793:0:19613:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789050231.689797:0:19613:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789050231.692386:0:19613:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff950704c52800 00000020:01000004:1.0:1789050231.692407:0:19613:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789050231.692419:0:19613:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789050231.692435:0:19613:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff95073f3d8000) 00000020:00000080:1.0:1789050231.692449:0:19613:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789050231.718134:0:19613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789050231.721585:0:19613:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789050231.722423:0:19613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789050231.724088:0:19613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789050231.724950:0:19613:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:0.0:1789050231.725341:0:19613:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1789050231.725484:0:19613:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1789050231.725578:0:19613:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1789050231.725966:0:19613:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 897: rc = 0 00100000:10000000:0.0:1789050231.727874:0:19613:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 897: rc = 0 00100000:10000000:0.0:1789050231.728138:0:19613:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 897: rc = 0 00100000:10000000:0.0:1789050231.728772:0:19613:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 897: rc = 0 00100000:10000000:0.0:1789050231.729033:0:19613:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 897: rc = 0 00100000:10000000:0.0:1789050231.729662:0:19613:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 897: rc = 0 00000020:00000080:0.0:1789050231.730240:0:19613:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789050231.730250:0:19613:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789050231.730260:0:19613:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9df728c939b7a2d1 00000020:01000004:0.0:1789050231.730268:0:19613:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1789050231.730287:0:19613:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.101@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789050231.730290:0:19613:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789050231.730310:0:19613:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789050231.730314:0:19613:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789050231.730324:0:19613:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff950706400000) 00000020:00000080:0.0:1789050231.730333:0:19613:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789050231.732827:0:19613:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789050231.732994:0:19613:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789050231.732999:0:19613:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789050231.742021:0:19613:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789050231.742163:0:19613:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789050231.742596:0:19613:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789050231.742602:0:19613:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789050231.744165:0:19613:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789050231.744362:0:19613:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789050231.744368:0:19613:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789050231.748875:0:19613:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789050231.748887:0:19613:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789050231.777479:0:19613:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789050231.778146:0:19613:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789050231.778154:0:19613:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789050231.783582:0:19613:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789050231.783597:0:19613:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789050231.785558:0:19613:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789050231.785579:0:19613:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789050231.788953:0:19613:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789050231.789327:0:19613:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789050231.789334:0:19613:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789050231.790002:0:19613:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789050231.790010:0:19613:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789050231.847369:0:19613:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789050231.847684:0:19613:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789050231.847690:0:19613:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789050231.850073:0:19613:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789050231.850088:0:19613:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789050231.850539:0:19613:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789050231.850574:0:19613:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789050231.850579:0:19613:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789050231.873845:0:19613:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.101@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789050231.873883:0:19613:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.101@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789050231.873888:0:19613:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789050231.873890:0:19613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789050231.873891:0:19613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789050231.873896:0:19613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789050231.873897:0:19613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789050231.873899:0:19613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789050231.873900:0:19613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789050231.873902:0:19613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789050231.873903:0:19613:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789050231.873907:0:19613:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789050231.873909:0:19613:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789050231.873910:0:19613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789050231.873911:0:19613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789050231.873912:0:19613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789050231.873913:0:19613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789050231.873914:0:19613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789050231.873915:0:19613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789050231.873916:0:19613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789050231.873917:0:19613:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789050231.873945:0:19613:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789050231.873966:0:19613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c029880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704170624:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789050231.874030:0:19613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050231.874165:0:19613:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507032eac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789050231.874512:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704170624 00000100:00100000:1.0:1789050231.874519:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704170624 00000100:00100000:1.0:1789050231.874584:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789050231.874594:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:19613:x1875954704170624:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789050231.874633:0:18926:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789050231.874636:0:18926:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789050231.874640:0:18926:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789050231.929731:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:19613:x1875954704170624:12345-0@lo:253:mount.lustre.0 Request processed in 55130us (55692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050231.929757:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789050231.929933:0:19613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c029880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704170624:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789050231.929949:0:19613:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789050231.929953:0:19613:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789050231.929954:0:19613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789050231.929955:0:19613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789050231.929957:0:19613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789050231.929958:0:19613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789050231.929959:0:19613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789050231.929961:0:19613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789050231.929962:0:19613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789050231.929964:0:19613:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789050231.929982:0:19613:0:(tgt_mount.c:101:server_register_mount()) register mount ffff950704c52800 from lustre-OST0000 10000000:01000000:0.0:1789050231.930006:0:19613:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789050231.930009:0:19613:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789050231.930015:0:19613:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff950704423380 local copy 00010000:00010000:0.0:1789050231.930025:0:19613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7a1c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a1ce expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050231.930434:0:19613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c029880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704170752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050231.930472:0:19613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050231.930547:0:19613:0:(client.c:2716:ptlrpc_set_wait()) set ffff950720aa99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050231.930641:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704170752 00000100:00100000:2.0:1789050231.930658:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704170752 00000100:00100000:2.0:1789050231.930732:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789050231.930742:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:19613:x1875954704170752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050231.930954:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:19613:x1875954704170752:12345-0@lo:501:mount.lustre.0 Request processed in 214us (480us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789050231.930962:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789050231.931038:0:19613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c029880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704170752:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789050231.931129:0:19613:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789050231.931480:0:19613:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789050231.931488:0:19613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7a1c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a1ce expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050231.931498:0:19613:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7a1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a1ce expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050231.931521:0:19613:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff950704c52800 10000000:01000000:1.0:1789050231.931525:0:19613:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789050231.931530:0:19613:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff950704423380 10000000:01000000:1.0:1789050231.931533:0:19613:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789050231.931536:0:19613:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff950704423380 from 1 10000000:01000000:1.0:1789050231.931544:0:19613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789050231.931696:0:19613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0ee00/0x9df728c939b7a2df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050231.931705:0:19613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073bc0ee00/0x9df728c939b7a2df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050231.931714:0:19613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073bc0ee00/0x9df728c939b7a2df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050231.931729:0:19613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704170880:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789050231.931761:0:19613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050231.931827:0:19613:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728c9ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789050231.931867:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704170880 00000100:00100000:2.0:1789050231.931872:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704170880 00000100:00100000:2.0:1789050231.931941:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789050231.931949:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+12:19613:x1875954704170880:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050231.931958:0:18926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050231.931970:0:18926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950702c51000/0x9df728c939b7a2e6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7a2df expref: -99 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050231.931988:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950702c51000/0x9df728c939b7a2e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7a2df expref: 13 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050231.931998:0:18926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950702c51000/0x9df728c939b7a2e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a2df expref: 13 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050231.932005:0:18926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51000, rc 0) 00000100:00100000:2.0:1789050231.932038:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+13:19613:x1875954704170880:12345-0@lo:101:mount.lustre.0 Request processed in 90us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050231.932150:0:19613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704170880:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050231.932163:0:19613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073bc0ee00/0x9df728c939b7a2df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a2e6 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050231.932171:0:19613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073bc0ee00/0x9df728c939b7a2df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7a2e6 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050231.932185:0:19613:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789050231.932219:0:19613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0ee00/0x9df728c939b7a2df lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a2e6 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050231.932235:0:19613:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073bc0ee00/0x9df728c939b7a2df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a2e6 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050231.932241:0:19613:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789050231.932245:0:19613:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789050231.932256:0:19613:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789050231.932258:0:19613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789050231.932272:0:19613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b7a2ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050231.932280:0:19613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b7a2ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050231.932287:0:19613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b7a2ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050231.932299:0:19613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704171008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789050231.932324:0:19613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050231.932468:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789050231.932680:0:19613:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728c9ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789050231.932746:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704171008 00000100:00100000:2.0:1789050231.932757:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704171008 00000100:00100000:2.0:1789050231.932777:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789050231.932783:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+13:19613:x1875954704171008:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050231.932791:0:18926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050231.932799:0:18926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950702c51e00/0x9df728c939b7a2f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7a2ed expref: -99 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050231.932813:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950702c51e00/0x9df728c939b7a2f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7a2ed expref: 14 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050231.932820:0:18926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950702c51e00/0x9df728c939b7a2f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a2ed expref: 14 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050231.932826:0:18926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51e00, rc 0) 00000100:00100000:2.0:1789050231.932860:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+14:19613:x1875954704171008:12345-0@lo:101:mount.lustre.0 Request processed in 77us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050231.932866:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789050231.932932:0:19613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704171008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050231.932942:0:19613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b7a2ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a2f4 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050231.932950:0:19613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b7a2ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7a2f4 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789050231.933743:0:19613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1789050231.934983:0:19613:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789050231.935460:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789050231.935500:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1789050231.935526:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1789050231.935632:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1789050231.935680:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1789050231.935725:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1789050231.935764:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1789050231.935801:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1789050231.935826:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1789050231.935864:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1789050231.935896:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1789050231.935933:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1789050231.935981:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1789050231.935987:0:19613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1789050231.936330:0:19613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704171136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050231.936382:0:19613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050231.936419:0:19613:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728c9a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789050231.936471:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704171136 00000100:00100000:3.0:1789050231.936478:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704171136 00000100:00100000:3.0:1789050231.936507:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789050231.936514:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+14:19613:x1875954704171136:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050231.936876:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+14:19613:x1875954704171136:12345-0@lo:501:mount.lustre.0 Request processed in 361us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050231.936884:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789050231.936958:0:19613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704171136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050231.936986:0:19613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704171264:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050231.937017:0:19613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050231.937035:0:19613:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728c9a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789050231.937141:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704171264 00000100:00100000:3.0:1789050231.937145:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704171264 00000100:00100000:3.0:1789050231.937173:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789050231.937179:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+14:19613:x1875954704171264:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789050231.937508:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+14:19613:x1875954704171264:12345-0@lo:503:mount.lustre.0 Request processed in 328us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050231.937528:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789050231.937793:0:19613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704171264:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789050231.938978:0:19613:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789050231.939131:0:19613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704171392:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050231.939352:0:19613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050231.939445:0:19613:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728c9a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789050231.939485:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704171392 00000100:00100000:3.0:1789050231.939492:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704171392 00000100:00100000:3.0:1789050231.939580:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789050231.939589:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+14:19613:x1875954704171392:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050231.939851:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+14:19613:x1875954704171392:12345-0@lo:502:mount.lustre.0 Request processed in 262us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050231.939858:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789050231.939995:0:19613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704171392:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789050231.940408:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789050231.940454:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1789050231.940482:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1789050231.940521:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1789050231.940553:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1789050231.940689:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1789050231.940741:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1789050231.940788:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1789050231.940818:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1789050231.940867:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1789050231.940905:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1789050231.940949:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1789050231.940985:0:19613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704171520:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050231.941034:0:19613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050231.941374:0:19613:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728c9a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789050231.941455:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704171520 00000100:00100000:0.0:1789050231.941461:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704171520 00000100:00100000:0.0:1789050231.941496:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789050231.941504:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+14:19613:x1875954704171520:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789050231.941712:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+14:19613:x1875954704171520:12345-0@lo:502:mount.lustre.0 Request processed in 208us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050231.941720:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789050231.941871:0:19613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704171520:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789050231.941948:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1789050231.941959:0:19613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1789050231.943837:0:19627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789050231.943846:0:19627:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789050231.943852:0:19627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050231.943854:0:19627:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789050231.943860:0:19627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789050231.943875:0:19627:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff95073d2299c0) 00000020:00000080:1.0:1789050231.943898:0:19627:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789050231.943904:0:19627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789050231.943971:0:19627:0:(tgt_mount.c:153:server_get_mount()) get mount ffff950704c52800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789050231.943980:0:19627:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789050231.943988:0:19627:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9df728c939b7a302 00010000:00010000:1.0:1789050231.951429:0:19627:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1789050231.951919:0:19627:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934593 00080000:10000000:1.0:1789050231.953875:0:19627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1789050231.955431:0:19627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789050231.955442:0:19627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789050231.955448:0:19627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050231.955450:0:19627:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789050231.955453:0:19627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789050231.955456:0:19627:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1789050231.955463:0:19627:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789050231.955465:0:19627:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789050231.955466:0:19627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789050231.955468:0:19627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050231.955470:0:19627:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789050231.955472:0:19627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789050231.955475:0:19627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050231.955476:0:19627:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789050231.955479:0:19627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789050231.955481:0:19627:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789050231.955483:0:19627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789050231.955485:0:19627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050231.955486:0:19627:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789050231.955488:0:19627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789050231.955490:0:19627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050231.955492:0:19627:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789050231.955494:0:19627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789050231.955544:0:19627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789050231.955548:0:19627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789050231.955549:0:19627:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789050231.955552:0:19627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1789050231.960939:0:19613:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789050231.960982:0:19613:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789050231.961005:0:19613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b7a2ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a2f4 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050231.961017:0:19613:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073bc0f000/0x9df728c939b7a2ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a2f4 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050231.961025:0:19613:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff950704c52800 from 1 10000000:01000000:3.0:1789050231.961028:0:19613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789050231.961160:0:19613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703330800/0x9df728c939b7a309 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050231.961169:0:19613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950703330800/0x9df728c939b7a309 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050231.961179:0:19613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950703330800/0x9df728c939b7a309 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050231.961328:0:19613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c271180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704171648:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789050231.961401:0:19613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050231.961444:0:19613:0:(client.c:2716:ptlrpc_set_wait()) set ffff950706388e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789050231.961518:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704171648 00000100:00100000:0.0:1789050231.961526:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704171648 00000100:00100000:0.0:1789050231.961580:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789050231.961589:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+14:19613:x1875954704171648:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050231.961600:0:18925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050231.961610:0:18925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950605f06a00/0x9df728c939b7a310 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7a309 expref: -99 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050231.961632:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950605f06a00/0x9df728c939b7a310 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7a309 expref: 15 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050231.961642:0:18925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950605f06a00/0x9df728c939b7a310 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a309 expref: 15 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050231.961659:0:18925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06a00, rc 0) 00000100:00100000:0.0:1789050231.961710:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+15:19613:x1875954704171648:12345-0@lo:101:mount.lustre.0 Request processed in 122us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050231.961724:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789050231.961867:0:19613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c271180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704171648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050231.961882:0:19613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950703330800/0x9df728c939b7a309 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a310 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050231.961890:0:19613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950703330800/0x9df728c939b7a309 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7a310 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789050231.962404:0:19613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:1.0:1789050231.962862:0:19613:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789050231.963115:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1789050231.963159:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1789050231.963338:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1789050231.963390:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1789050231.963424:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1789050231.963472:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1789050231.963508:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1789050231.963541:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1789050231.963697:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1789050231.963705:0:19613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:1.0:1789050231.963780:0:19613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704171776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050231.963832:0:19613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050231.963867:0:19613:0:(client.c:2716:ptlrpc_set_wait()) set ffff950742051180 going to sleep for 11 seconds 00000100:00100000:0.0:1789050231.963951:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704171776 00000100:00100000:0.0:1789050231.963958:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704171776 00000100:00100000:0.0:1789050231.964001:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789050231.964011:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+15:19613:x1875954704171776:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050231.964255:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+15:19613:x1875954704171776:12345-0@lo:501:mount.lustre.0 Request processed in 245us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050231.964262:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789050231.964471:0:19613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704171776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050231.964500:0:19613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704171904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050231.964540:0:19613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050231.964648:0:19613:0:(client.c:2716:ptlrpc_set_wait()) set ffff950742051180 going to sleep for 11 seconds 00000100:00100000:3.0:1789050231.964717:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704171904 00000100:00100000:3.0:1789050231.964722:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704171904 00000100:00100000:3.0:1789050231.964754:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789050231.964762:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+15:19613:x1875954704171904:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789050231.964892:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+15:19613:x1875954704171904:12345-0@lo:503:mount.lustre.0 Request processed in 130us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050231.964900:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789050231.964984:0:19613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704171904:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789050231.965744:0:19613:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789050231.965802:0:19613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704172032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050231.965845:0:19613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050231.965913:0:19613:0:(client.c:2716:ptlrpc_set_wait()) set ffff950701359240 going to sleep for 11 seconds 00000100:00100000:3.0:1789050231.972490:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704172032 00000100:00100000:3.0:1789050231.972504:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704172032 00000100:00100000:3.0:1789050231.972711:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789050231.972855:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+15:19613:x1875954704172032:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050231.973419:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+15:19613:x1875954704172032:12345-0@lo:502:mount.lustre.0 Request processed in 698us (7573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050231.973429:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789050231.973577:0:19613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704172032:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789050231.974148:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789050231.980273:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1789050231.980416:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1789050231.980462:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1789050231.980498:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1789050231.981362:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1789050231.981421:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1789050231.981476:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:3.0:1789050231.981662:0:19613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c270000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704172160:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050231.981979:0:19613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050231.982025:0:19613:0:(client.c:2716:ptlrpc_set_wait()) set ffff950706388d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789050231.982101:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704172160 00000100:00100000:0.0:1789050231.982110:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704172160 00000100:00100000:0.0:1789050231.982164:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789050231.982173:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+15:19613:x1875954704172160:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789050231.982471:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+15:19613:x1875954704172160:12345-0@lo:502:mount.lustre.0 Request processed in 299us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050231.982480:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789050231.983133:0:19613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c270000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704172160:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789050231.983384:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1789050231.983400:0:19613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789050231.990737:0:19631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050231.990751:0:19631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050231.990753:0:19631:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789050231.990760:0:19631:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff950704c52800 00000020:00000080:0.0:1789050231.990763:0:19631:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789050231.990769:0:19631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050231.990772:0:19631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050231.990773:0:19631:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789050231.990776:0:19631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050231.990780:0:19631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050231.990781:0:19631:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789050231.990783:0:19631:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff950704c52800 00000020:00000080:0.0:1789050231.990785:0:19631:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789050231.990870:0:19631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050231.990874:0:19631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050231.990875:0:19631:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789050231.990877:0:19631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050231.990880:0:19631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050231.990881:0:19631:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789050231.990884:0:19631:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff950704c52800 00000020:00000080:0.0:1789050231.990886:0:19631:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789050231.990928:0:19631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050231.990932:0:19631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050231.990933:0:19631:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789050231.990936:0:19631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:1.0:1789050231.994488:0:19613:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789050231.994525:0:19613:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789050231.994580:0:19613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703330800/0x9df728c939b7a309 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a310 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050231.994592:0:19613:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950703330800/0x9df728c939b7a309 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a310 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050231.994638:0:19613:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789050231.994663:0:19613:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff950704c52800 10000000:01000000:1.0:1789050231.994666:0:19613:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff950704c52800 10000000:01000000:1.0:1789050231.994670:0:19613:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789050231.994676:0:19613:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff950704c52800 from 1 10000000:01000000:1.0:1789050231.994678:0:19613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789050231.994711:0:19613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b7a317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050231.994719:0:19613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b7a317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050231.994729:0:19613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b7a317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050231.994751:0:19613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704172288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789050231.994808:0:19613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050231.994847:0:19613:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728c9a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789050231.997275:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704172288 00000100:00100000:3.0:1789050231.997287:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704172288 00000100:00100000:3.0:1789050231.997348:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789050231.997358:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+15:19613:x1875954704172288:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050231.997373:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050231.997388:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703330000/0x9df728c939b7a31e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7a317 expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050231.997414:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703330000/0x9df728c939b7a31e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7a317 expref: 16 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050231.997425:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703330000/0x9df728c939b7a31e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a317 expref: 16 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050231.997434:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330000, rc 0) 00000100:00100000:3.0:1789050231.997499:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:19613:x1875954704172288:12345-0@lo:101:mount.lustre.0 Request processed in 142us (2690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050231.997506:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789050231.998284:0:19613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704172288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789050231.998304:0:19613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b7a317 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a31e expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050231.998314:0:19613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b7a317 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7a31e expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789050231.998865:0:19613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:1.0:1789050231.999339:0:19613:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789050231.999614:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1789050232.000159:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1789050232.000220:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1789050232.001771:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1789050232.001834:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1789050232.001885:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1789050232.001921:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1789050232.001956:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1789050232.002006:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1789050232.003401:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1789050232.003502:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1789050232.003587:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1789050232.003626:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1789050232.003675:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1789050232.003725:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1789050232.003760:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1789050232.003793:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1789050232.003857:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1789050232.003895:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1789050232.003929:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1789050232.003977:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1789050232.004013:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1789050232.005363:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1789050232.005461:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1789050232.005498:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:1.0:1789050232.008257:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:1.0:1789050232.008377:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:1.0:1789050232.008416:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:1.0:1789050232.008448:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:1.0:1789050232.008509:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:1.0:1789050232.008547:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:1.0:1789050232.008581:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:1.0:1789050232.008614:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:1.0:1789050232.008693:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:1.0:1789050232.008730:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:1.0:1789050232.008792:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:1.0:1789050232.008832:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:1.0:1789050232.008879:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:1.0:1789050232.008928:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:1.0:1789050232.008964:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:1.0:1789050232.009078:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:1.0:1789050232.009086:0:19613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:1.0:1789050232.009177:0:19613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704172416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050232.009268:0:19613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050232.009327:0:19613:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728c9a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789050232.009381:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704172416 00000100:00100000:2.0:1789050232.009389:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704172416 00000100:00100000:2.0:1789050232.009435:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789050232.009444:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:19613:x1875954704172416:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050232.009710:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:19613:x1875954704172416:12345-0@lo:501:mount.lustre.0 Request processed in 265us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050232.009718:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789050232.014346:0:19613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704172416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050232.014432:0:19613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704172544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050232.014502:0:19613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050232.014539:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704172544 00000100:00100000:1.0:1789050232.014545:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704172544 00000100:00100000:1.0:1789050232.014589:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789050232.014597:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:19613:x1875954704172544:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050232.014776:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:19613:x1875954704172544:12345-0@lo:503:mount.lustre.0 Request processed in 178us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050232.014784:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789050232.014830:0:19613:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728c9a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789050232.014845:0:19613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704172544:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789050232.018780:0:19613:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789050232.018871:0:19613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704172672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050232.018945:0:19613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050232.018996:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704172672 00000100:00100000:1.0:1789050232.019004:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704172672 00000100:00100000:1.0:1789050232.019039:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789050232.019062:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:19613:x1875954704172672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789050232.021339:0:19613:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070356c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789050232.023105:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:19613:x1875954704172672:12345-0@lo:502:mount.lustre.0 Request processed in 4038us (4154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050232.023118:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789050232.023195:0:19613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704172672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789050232.023471:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789050232.023522:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1789050232.023548:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1789050232.023586:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1789050232.023615:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1789050232.023681:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1789050232.023717:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1789050232.023748:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1789050232.023794:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1789050232.023828:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1789050232.023857:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1789050232.023899:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1789050232.023932:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1789050232.023962:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1789050232.024006:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1789050232.024040:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1789050232.024074:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1789050232.024130:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1789050232.024165:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1789050232.024191:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1789050232.024253:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1789050232.024295:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1789050232.024321:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1789050232.024364:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1789050232.024398:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:1.0:1789050232.024430:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:1.0:1789050232.024490:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:1.0:1789050232.024525:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:1.0:1789050232.024557:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:1.0:1789050232.024599:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:1.0:1789050232.024634:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:1.0:1789050232.024683:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:1.0:1789050232.024716:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:1.0:1789050232.024776:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:1.0:1789050232.024816:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:1.0:1789050232.024862:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:1.0:1789050232.024899:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:1.0:1789050232.024949:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:1.0:1789050232.025001:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:1.0:1789050232.025037:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:1.0:1789050232.025079:0:19613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704172800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050232.025143:0:19613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050232.025193:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704172800 00000100:00100000:1.0:1789050232.025221:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704172800 00000100:00100000:1.0:1789050232.025260:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789050232.025268:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:19613:x1875954704172800:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050232.025463:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:19613:x1875954704172800:12345-0@lo:502:mount.lustre.0 Request processed in 194us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050232.025471:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789050232.025521:0:19613:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070356c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789050232.025540:0:19613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704172800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789050232.025603:0:19613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:1.0:1789050232.032343:0:19613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789050232.036367:0:19636:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789050232.036383:0:19636:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff950706403380) 00000020:00000080:0.0:1789050232.036405:0:19636:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789050232.036503:0:19636:0:(tgt_mount.c:153:server_get_mount()) get mount ffff950704c52800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789050232.036507:0:19636:0:(tgt_mount.c:187:server_put_mount()) put mount ffff950704c52800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789050232.036510:0:19636:0:(obd_mount.c:710:lustre_put_lsi()) put ffff950704c52800 3 00010000:00080000:0.0:1789050232.036538:0:19636:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9506059e8000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.101@tcp at head 00010000:00010000:0.0:1789050232.038916:0:19636:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1789050232.039474:0:19636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789050232.039521:0:19636:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789050232.039531:0:19636:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9df728c939b7a32c 00000100:00080000:0.0:1789050232.039541:0:19636:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789050232.039551:0:19636:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9506059e8000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:0.0:1789050232.039580:0:19636:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c02ad80 x1875954704172928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789050232.039615:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c02ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875954704172928:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789050232.039681:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050232.039753:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704172928 00000100:00100000:0.0:1789050232.039759:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704172928 00000100:00100000:0.0:1789050232.039784:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789050232.039790:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3281:x1875954704172928:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789050232.039809:0:18934:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:0.0:1789050232.039835:0:18934:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9df728c939b7a333 00000004:00100000:0.0:1789050232.039848:0:18934:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789050232.039982:0:18934:0:(import.c:65:import_set_state_nolock()) ffff9506059eb800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789050232.040348:0:19636:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789050232.040357:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875954704172928:12345-0@lo:38:llog_process_th.0 Request processed in 566us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050232.040365:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789050232.040404:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95073c02ad80 x1875954704172928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789050242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050232.040413:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789050232.040420:0:3281:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1789050232.040426:0:3281:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789050232.040430:0:3281:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789050232.040432:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9506059e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789050232.040437:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c02ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3281:1875954704172928:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789050232.040457:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789050232.040461:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789050232.040463:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789050232.040466:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789050232.040512:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789050232.040520:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c02ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875954704173056:0@lo:400:kworker.0 00000100:00100000:0.0:1789050232.040559:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050232.040589:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704173056 00000100:00100000:0.0:1789050232.040594:0:18932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704173056 00000100:00100000:0.0:1789050232.040619:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789050232.040625:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875954704173056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050232.040675:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875954704173056:12345-0@lo:400:kworker.0 Request processed in 50us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050232.040681:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789050232.040707:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95073c02ad80 x1875954704173056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050232.040717:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c02ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875954704173056:0@lo:400:kworker.0 00000040:00080000:2.0:1789050232.042379:0:19636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:1.0:1789050232.043094:0:19613:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789050232.043119:0:19613:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789050232.043147:0:19613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b7a317 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a31e expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050232.043158:0:19613:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073bc0f400/0x9df728c939b7a317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a31e expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789050232.043231:0:19613:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789050232.043234:0:19613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789050232.043235:0:19613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789050232.043236:0:19613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789050232.043237:0:19613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789050232.043239:0:19613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789050232.043240:0:19613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789050232.043241:0:19613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789050232.043243:0:19613:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789050232.043246:0:19613:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789050232.043248:0:19613:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789050232.043250:0:19613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789050232.043251:0:19613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789050232.043252:0:19613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789050232.043253:0:19613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789050232.043254:0:19613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789050232.043255:0:19613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789050232.043256:0:19613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789050232.043257:0:19613:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789050232.043280:0:19613:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789050232.043298:0:19613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704173184:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789050232.043363:0:19613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050232.043402:0:19613:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070356c240 going to sleep for 11 seconds 00000100:00100000:2.0:1789050232.043479:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704173184 00000100:00100000:2.0:1789050232.043486:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704173184 00000100:00100000:2.0:1789050232.043528:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789050232.043537:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:19613:x1875954704173184:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789050232.043571:0:18926:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789050232.043584:0:18926:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789050232.112714:0:18926:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789050232.112735:0:18926:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789050232.114438:0:18948:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789050232.114446:0:18948:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789050232.114466:0:18948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff950703330200/0x9df728c939b7a33a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050232.114484:0:18948:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950703331c00/0x9df728c939b7a2a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a2a0 expref: 16 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050232.114494:0:18948:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff950703330200/0x9df728c939b7a33a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050232.114542:0:18948:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950703331c00/0x9df728c939b7a2a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b7a2a0 expref: 16 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050232.114557:0:18948:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff950703331c00/0x9df728c939b7a2a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b7a2a0 expref: 16 pid: 18927 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050232.114570:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c270000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18948:1875954704173312:0@lo:104: 00000100:00100000:3.0:1789050232.114629:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050232.114682:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070635d600 going to sleep for 11 seconds 00000100:00100000:2.0:1789050232.114744:0:18916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704173312 00000100:00100000:2.0:1789050232.114752:0:18916:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704173312 00000100:00100000:2.0:1789050232.114802:0:18916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789050232.114812:0:18916:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c270380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7878f230-1e80-42fc-b48c-88e089c8a2b3+3:18948:x1875954704173312:12345-0@lo:104: 00010000:00010000:2.0:1789050232.114824:0:18916:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b7a2a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7a2a7 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050232.114888:0:18916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789050232.114894:0:18916:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c270380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7878f230-1e80-42fc-b48c-88e089c8a2b3+3:18948:x1875954704173312:12345-0@lo:104: Request processed in 85us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050232.114901:0:18916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789050232.114920:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050232.114925:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b7a2a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7a2a7 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050232.114932:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50800 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:2.0:1789050232.114936:0:18921:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b7a2a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b7a2a7 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050232.114944:0:18921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b7a2a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b7a2a7 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789050232.114963:0:18921:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b7a2a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b7a2a7 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050232.114969:0:18921:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789050232.114997:0:18921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b7a2a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a2a7 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050232.115004:0:18921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789050232.115024:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b7a2a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a2a7 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050232.115031:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950702c50800/0x9df728c939b7a2a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a2a7 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050232.115244:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050232.115247:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050232.115249:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050232.115271:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7878f230-1e80-42fc-b48c-88e089c8a2b3:3282:1875954704173440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789050232.115301:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050232.115350:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c270000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18948:1875954704173312:0@lo:104: 00010000:00010000:2.0:1789050232.115368:0:18948:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff950703330200/0x9df728c939b7a33a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050232.115482:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704173440 00000100:00100000:3.0:1789050232.115487:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704173440 00010000:00010000:3.0:1789050232.115505:0:18919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950703331c00/0x9df728c939b7a2a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7a2a0 expref: 17 pid: 18927 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050232.115535:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789050232.115543:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720824380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7878f230-1e80-42fc-b48c-88e089c8a2b3+17:3282:x1875954704173440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789050232.115552:0:18919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050232.115556:0:18919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950703331c00/0x9df728c939b7a2a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7a2a0 expref: 17 pid: 18927 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050232.115565:0:18919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950703331c00/0x9df728c939b7a2a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b7a2a0 expref: 17 pid: 18927 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050232.115577:0:18919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703331c00/0x9df728c939b7a2a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b7a2a0 expref: 17 pid: 18927 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050232.115589:0:18919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff950703330200/0x9df728c939b7a33a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050232.115608:0:18919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703330200/0x9df728c939b7a33a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789050232.115619:0:18919:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001246588s 00010000:00010000:3.0:1789050232.115626:0:18919:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950703330200/0x9df728c939b7a33a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050232.115631:0:18919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950703330200/0x9df728c939b7a33a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050232.115637:0:18919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff950703330200/0x9df728c939b7a33a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050232.115643:0:18919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff950703330200/0x9df728c939b7a33a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050232.115658:0:18919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050232.115662:0:18919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff950703330200/0x9df728c939b7a33a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050232.115669:0:18919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff950703330200/0x9df728c939b7a33a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050232.115681:0:18919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff950703330200/0x9df728c939b7a33a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050232.115690:0:18919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050232.115718:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720824380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:3282:x1875954704173440:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050232.115724:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789050232.116246:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7878f230-1e80-42fc-b48c-88e089c8a2b3:3282:1875954704173440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789050232.116271:0:18948:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff950703330200/0x9df728c939b7a33a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050232.116279:0:18948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff950703330200/0x9df728c939b7a33a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050232.116292:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703330200/0x9df728c939b7a33a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050232.123607:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+15:19613:x1875954704173184:12345-0@lo:253:mount.lustre.0 Request processed in 80064us (80236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050232.123622:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789050232.123736:0:19613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:19613:1875954704173184:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789050232.123751:0:19613:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789050232.123754:0:19613:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789050232.123756:0:19613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789050232.123757:0:19613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789050232.123759:0:19613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789050232.123772:0:19613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789050232.123774:0:19613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789050232.123776:0:19613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789050232.123777:0:19613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789050232.123779:0:19613:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789050232.123794:0:19613:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789050232.124452:0:19613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789050232.124622:0:19613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789050232.124779:0:19613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789050232.124911:0:19613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789050232.125297:0:19613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789050232.125489:0:19613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789050232.126645:0:19613:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1789050232.191816:0:19613:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789050232.191826:0:19613:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789050232.191858:0:19613:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789050232.191917:0:19613:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.101@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789050232.191935:0:19613:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789050232.191963:0:19613:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789050232.401331:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050233.419313:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789050233.420329:0:18930:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789050233.420334:0:18930:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95072f422000 from 10 10000000:01000000:2.0:1789050233.420339:0:18930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789050233.420379:0:18930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c50c00/0x9df728c939b7a341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050233.420389:0:18930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950702c50c00/0x9df728c939b7a341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050233.420399:0:18930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950702c50c00/0x9df728c939b7a341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050233.420421:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704173568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789050233.421343:0:18930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050233.421397:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507032f9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789050233.421664:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704173568 00000100:00100000:3.0:1789050233.421673:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704173568 00000100:00100000:3.0:1789050233.421719:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789050233.421729:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+15:18930:x1875954704173568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050233.421742:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050233.421759:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703331c00/0x9df728c939b7a348 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7a341 expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050233.421784:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703331c00/0x9df728c939b7a348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7a341 expref: 16 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050233.421796:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703331c00/0x9df728c939b7a348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a341 expref: 16 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050233.421804:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331c00, rc 0) 00000100:00100000:3.0:1789050233.423372:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:18930:x1875954704173568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1638us (2025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050233.423383:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789050233.423680:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704173568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789050233.423703:0:18930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950702c50c00/0x9df728c939b7a341 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a348 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050233.423716:0:18930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950702c50c00/0x9df728c939b7a341 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7a348 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050233.423785:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c02ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704173696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789050233.423830:0:18930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050233.423871:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f3c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789050233.424801:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704173696 00000100:00100000:3.0:1789050233.424810:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704173696 00000100:00100000:3.0:1789050233.424863:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789050233.424871:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:18930:x1875954704173696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789050233.424891:0:18926:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789050233.424908:0:18926:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789050233.424911:0:18926:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1789050233.425021:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:18930:x1875954704173696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 149us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050233.425040:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789050233.425268:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c02ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704173696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789050233.425332:0:18930:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789050233.425341:0:18930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c50c00/0x9df728c939b7a341 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a348 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050233.425352:0:18930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950702c50c00/0x9df728c939b7a341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a348 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050234.446871:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050235.468442:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050236.495238:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789050237.070127:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050237.070134:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789050237.070137:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789050237.070140:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789050237.070187:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7878f230-1e80-42fc-b48c-88e089c8a2b3:3283:1875954704173824:0@lo:400:kworker.0 00000100:00100000:1.0:1789050237.070265:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050237.070338:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875954704173952:0@lo:400:kworker.0 00000100:00100000:1.0:1789050237.070367:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050237.070390:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789050237.070396:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875954704174080:0@lo:400:kworker.0 00000100:00100000:1.0:1789050237.070421:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050237.070461:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704173952 00000100:00100000:1.0:1789050237.070468:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704173952 00000100:00100000:1.0:1789050237.070501:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704174080 00000100:00100000:1.0:1789050237.070504:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704174080 00000100:00100000:1.0:1789050237.070528:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789050237.070543:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875954704173952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050237.070591:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875954704173952:12345-0@lo:400:kworker.0 Request processed in 49us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050237.070597:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789050237.070613:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789050237.070618:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875954704174080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050237.070655:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875954704174080:12345-0@lo:400:kworker.0 Request processed in 37us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050237.070661:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789050237.070695:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789050237.070720:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95073c517100 x1875954704174080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050237.070732:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875954704174080:0@lo:400:kworker.0 00010000:00080000:1.0:1789050237.070743:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95073c516d80 x1875954704173952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050237.070752:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875954704173952:0@lo:400:kworker.0 00000100:00100000:3.0:1789050237.070943:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704173824 00000100:00100000:3.0:1789050237.070948:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704173824 00000100:00100000:3.0:1789050237.070981:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789050237.070988:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:3283:x1875954704173824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050237.071027:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:3283:x1875954704173824:12345-0@lo:400:kworker.0 Request processed in 40us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050237.071033:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789050237.071064:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7878f230-1e80-42fc-b48c-88e089c8a2b3:3283:1875954704173824:0@lo:400:kworker.0 00010000:00010000:2.0:1789050237.518389:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789050238.402173:0:19982:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg601-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789050238.539333:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050239.563399:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050240.587497:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050241.612346:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789050241.867815:0:18964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1789050242.187430:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789050242.187436:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789050242.187445:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789050242.187448:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789050242.187499:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789050242.187519:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704174464:0@lo:400:kworker.0 00000100:00100000:2.0:1789050242.187589:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050242.187698:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704174336:0@lo:400:kworker.0 00000100:00100000:3.0:1789050242.187730:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050242.187758:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789050242.187764:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7878f230-1e80-42fc-b48c-88e089c8a2b3:3283:1875954704174208:0@lo:400:kworker.0 00000100:00100000:3.0:1789050242.187790:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050242.188053:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704174208 00000100:00100000:0.0:1789050242.188061:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704174208 00000100:00100000:0.0:1789050242.188114:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789050242.188124:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:3283:x1875954704174208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050242.188173:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:3283:x1875954704174208:12345-0@lo:400:kworker.0 Request processed in 51us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050242.188180:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789050242.188564:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704174464 00000100:00100000:1.0:1789050242.188570:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704174464 00000100:00100000:1.0:1789050242.188623:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704174336 00000100:00100000:1.0:1789050242.188626:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704174336 00000100:00100000:1.0:1789050242.188641:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789050242.188649:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704174464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050242.188693:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704174464:12345-0@lo:400:kworker.0 Request processed in 45us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050242.188714:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789050242.188732:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789050242.188738:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704174336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050242.188773:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704174336:12345-0@lo:400:kworker.0 Request processed in 36us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050242.188781:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789050242.189022:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950720827b80 x1875954704174464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789050242.189035:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704174464:0@lo:400:kworker.0 00000100:00100000:3.0:1789050242.189224:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7878f230-1e80-42fc-b48c-88e089c8a2b3:3283:1875954704174208:0@lo:400:kworker.0 00010000:00080000:3.0:1789050242.189241:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950720826d80 x1875954704174336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050242.189251:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704174336:0@lo:400:kworker.0 00000100:00080000:0.0:1789050242.189436:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789050242.637299:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050243.659413:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050244.305401:0:3281:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789050229/real 1789050229] req@ffff95073c270700 x1875954704170368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050244 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050244.305442:0:3281:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95073c270700 x1875954704170368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050244 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050244.305454:0:3281:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789050229/real 1789050229] req@ffff95073c273b80 x1875954704170496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050244 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050244.305466:0:3281:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95073c273b80 x1875954704170496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789050244 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789050244.305499:0:3281:0:(import.c:65:import_set_state_nolock()) ffff950703cfb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789050244.305610:0:3281:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789050244.305615:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704170368:0@lo:8:kworker.0 00000100:00080000:0.0:1789050244.305622:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9507039ef000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1789050244.310711:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7878f230-1e80-42fc-b48c-88e089c8a2b3:3285:1875954704174592:0@lo:400:kworker.0 00000100:00100000:3.0:1789050244.310980:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789050244.311236:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789050244.311243:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789050244.311247:0:38:0:(import.c:65:import_set_state_nolock()) ffff950703cfb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789050244.311255:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:2.0:1789050244.311261:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789050244.311273:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff950703cfb000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:2.0:1789050244.311305:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff950720826a00 x1875954704174720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789050244.311320:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789050244.311323:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789050244.311325:0:38:0:(import.c:65:import_set_state_nolock()) ffff9507039ef000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789050244.311328:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:2.0:1789050244.311330:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789050244.311335:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9507039ef000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:2.0:1789050244.311347:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff950720825880 x1875954704174848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789050244.311431:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704174976:0@lo:400:kworker.0 00000100:00100000:2.0:1789050244.311473:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050244.311505:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050244.311520:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704175104:0@lo:400:kworker.0 00000100:00100000:2.0:1789050244.311550:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050244.311607:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704174976 00000100:00100000:2.0:1789050244.311616:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704174976 00000100:00100000:2.0:1789050244.311666:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704175104 00000100:00100000:2.0:1789050244.311669:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704175104 00000100:00100000:2.0:1789050244.311709:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789050244.311720:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704174976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050244.311775:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875954704174976:12345-0@lo:400:kworker.0 Request processed in 56us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050244.311784:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789050244.311801:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789050244.311808:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704175104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050244.311834:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875954704175104:12345-0@lo:400:kworker.0 Request processed in 27us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050244.311840:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789050244.311882:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950720826680 x1875954704175104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050244.312027:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1875954704175104:0@lo:400:kworker.0 00010000:00080000:2.0:1789050244.312043:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950720824000 x1875954704174976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789050244.312054:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875954704174976:0@lo:400:kworker.0 00000100:00100000:2.0:1789050244.312177:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704174592 00000100:00100000:2.0:1789050244.312183:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704174592 00000100:00100000:2.0:1789050244.312247:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789050244.312257:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:3285:x1875954704174592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050244.312576:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:3285:x1875954704174592:12345-0@lo:400:kworker.0 Request processed in 320us (1596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050244.312593:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789050244.312764:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7878f230-1e80-42fc-b48c-88e089c8a2b3:3285:1875954704174592:0@lo:400:kworker.0 00000100:00080000:0.0:1789050244.313223:0:3281:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789050244.313231:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704170496:0@lo:8:kworker.0 00000100:00080000:0.0:1789050244.313262:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050244.313280:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704174720:0@lo:8:kworker.0 00000100:00100000:0.0:1789050244.313338:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050244.313382:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704174720 00000100:00100000:0.0:1789050244.313388:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704174720 00000100:00100000:0.0:1789050244.313421:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789050244.313429:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3281:x1875954704174720:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789050244.313460:0:19614:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:0.0:1789050244.313495:0:19614:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9df728c939b7a34f 00002000:00100000:0.0:1789050244.313513:0:19614:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9506059ef800 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789050244.313517:0:19614:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789050244.313520:0:19614:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789050244.315088:0:19614:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789050244.315131:0:19614:0:(import.c:65:import_set_state_nolock()) ffff9506059ea000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789050244.315232:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1875954704174720:12345-0@lo:8:kworker.0 Request processed in 1801us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050244.315243:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789050244.315319:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff950720826a00 x1875954704174720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789050264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050244.315342:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789050244.315354:0:3281:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789050244.315364:0:3281:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:0.0:1789050244.315371:0:3281:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789050244.315373:0:3281:0:(import.c:65:import_set_state_nolock()) ffff950703cfb000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789050244.315390:0:3281:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789050244.315396:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704174720:0@lo:8:kworker.0 00000100:00100000:0.0:1789050244.315409:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704174848:0@lo:8:kworker.0 00000100:00100000:0.0:1789050244.315451:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050244.315515:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704174848 00000100:00100000:0.0:1789050244.315521:0:19617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704174848 00000004:00080000:3.0:1789050244.315529:0:18955:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1789050244.315546:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789050244.315549:0:18955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c271880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18955:1875954704175360:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789050244.315553:0:19617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c029880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3281:x1875954704174848:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789050244.315572:0:19617:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789050244.315592:0:18955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050244.315611:0:18955:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507032f9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050244.315618:0:19617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c029880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3281:x1875954704174848:12345-0@lo:8:kworker.0 Request processed in 65us (167us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789050244.315624:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:3.0:1789050244.315629:0:18954:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1789050244.315634:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704175360 00000100:00100000:0.0:1789050244.315637:0:19617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704175360 00000100:00100000:0.0:1789050244.315664:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789050244.315670:0:19617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18955:x1875954704175360:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789050244.316084:0:18954:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 480303883131ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789050244.316113:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c270e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704175232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789050244.316146:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050244.316275:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704175232 00000100:00100000:3.0:1789050244.316280:0:19618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704175232 00000100:00100000:3.0:1789050244.316314:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789050244.316321:0:19618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1875954704175232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050244.316348:0:19618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789050244.316386:0:19618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1875954704175232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050244.316394:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789050244.317058:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95073c270e00 x1875954704175232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050244.317080:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c270e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704175232:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1789050244.322546:0:19617:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789050244.322561:0:19617:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:0.0:1789050244.322568:0:19617:0:(ofd_dev.c:1497:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:65) 00000100:00080000:0.0:1789050244.343918:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1789050244.345498:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00080000:0.0:1789050244.346354:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9507039ef000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789050244.346365:0:3281:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789050244.346370:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704174848:0@lo:8:kworker.0 00010000:00010000:2.0:1789050244.347118:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b7a356 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.347141:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.347147:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.347155:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b7a356 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.347180:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b7a356 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.347193:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b7a356 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.347220:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b7a356 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.347241:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789050244.347356:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050244.347366:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b7a356 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.347375:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050244.347381:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b7a356 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.347399:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b7a356 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.347421:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b7a356 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.347428:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b7a356 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.347448:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050244.347450:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050244.347451:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050244.348594:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.348606:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a35d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.348622:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.348635:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.348641:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a35d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.348655:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a35d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.349161:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a35d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.349172:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a35d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.349221:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050244.349351:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050244.349361:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a35d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.349371:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050244.349376:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a35d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.349388:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a35d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.349412:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a35d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.349422:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a35d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.349447:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.349450:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.349452:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050244.351245:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.351259:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a364 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.351278:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.351283:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.351289:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a364 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.351305:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a364 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.351316:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a364 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.351333:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a364 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.351355:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050244.351372:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050244.351379:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a364 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.351388:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050244.351393:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a364 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.351404:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a364 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.351423:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a364 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.351431:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a364 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.351448:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050244.351450:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050244.351452:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050244.356854:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050244.356869:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d79c038/0x9df728c939b7a36b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.356904:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1789050244.356909:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050244.356917:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d79c038/0x9df728c939b7a36b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.356944:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d79c038/0x9df728c939b7a36b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.356957:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d79c038/0x9df728c939b7a36b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.356973:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d79c038/0x9df728c939b7a36b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.356992:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789050244.358141:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050244.358152:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001da5cdfc/0x9df728c939b7a372 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.358169:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1789050244.358174:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050244.358180:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001da5cdfc/0x9df728c939b7a372 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.358903:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001da5cdfc/0x9df728c939b7a372 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.358917:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001da5cdfc/0x9df728c939b7a372 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.358925:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001da5cdfc/0x9df728c939b7a372 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.359379:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050244.359390:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d79c038/0x9df728c939b7a36b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.359427:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050244.359433:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d79c038/0x9df728c939b7a36b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.359445:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d79c038/0x9df728c939b7a36b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.359467:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d79c038/0x9df728c939b7a36b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.359475:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d79c038/0x9df728c939b7a36b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.359496:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.359498:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.359499:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050244.360602:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050244.361642:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050244.361654:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001da5cdfc/0x9df728c939b7a372 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.361668:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050244.361673:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001da5cdfc/0x9df728c939b7a372 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.361685:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001da5cdfc/0x9df728c939b7a372 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.361717:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001da5cdfc/0x9df728c939b7a372 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.361727:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001da5cdfc/0x9df728c939b7a372 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.361749:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.361751:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.361753:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050244.364815:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050244.364833:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b7a379 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.364863:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1789050244.364868:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050244.364876:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b7a379 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.364894:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b7a379 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.364907:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b7a379 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.364915:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b7a379 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.364945:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789050244.364967:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050244.364973:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b7a379 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.364982:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330e00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050244.364987:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b7a379 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.364997:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b7a379 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.365029:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b7a379 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.365037:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b7a379 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.365061:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050244.365063:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050244.365065:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050244.365845:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050244.365854:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b7a380 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.365867:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1789050244.365871:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050244.365877:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b7a380 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.365889:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b7a380 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.365897:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b7a380 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.365905:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b7a380 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.365941:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789050244.365956:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050244.365962:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b7a380 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.365970:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050244.365974:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b7a380 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.365983:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b7a380 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.365998:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b7a380 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.366006:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c339402/0x9df728c939b7a380 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.366023:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050244.366025:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050244.366027:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050244.366467:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050244.366474:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b7a387 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.366484:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1789050244.366496:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050244.366501:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b7a387 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.366512:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b7a387 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.366521:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b7a387 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.366528:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b7a387 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.366545:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789050244.366555:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050244.366560:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b7a387 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.366567:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050244.366571:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b7a387 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.366578:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b7a387 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.366602:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b7a387 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.366621:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004184e3e6/0x9df728c939b7a387 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.366636:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050244.366638:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050244.366639:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050244.367068:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050244.367075:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a115795e/0x9df728c939b7a38e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.367084:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1789050244.367088:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050244.367092:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a115795e/0x9df728c939b7a38e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.367103:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a115795e/0x9df728c939b7a38e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.367112:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a115795e/0x9df728c939b7a38e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.367119:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a115795e/0x9df728c939b7a38e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.367137:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789050244.367146:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050244.367156:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a115795e/0x9df728c939b7a38e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.367164:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331a00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050244.367167:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a115795e/0x9df728c939b7a38e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.367175:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a115795e/0x9df728c939b7a38e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.367187:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a115795e/0x9df728c939b7a38e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.367195:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a115795e/0x9df728c939b7a38e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.367235:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050244.367237:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050244.367239:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050244.367643:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050244.367649:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ae6e9c/0x9df728c939b7a395 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.367660:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1789050244.367663:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050244.367667:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027ae6e9c/0x9df728c939b7a395 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.367689:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027ae6e9c/0x9df728c939b7a395 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.367697:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ae6e9c/0x9df728c939b7a395 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.367705:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027ae6e9c/0x9df728c939b7a395 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.367721:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789050244.367730:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050244.367734:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027ae6e9c/0x9df728c939b7a395 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.367741:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331e00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050244.367744:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ae6e9c/0x9df728c939b7a395 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.367753:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ae6e9c/0x9df728c939b7a395 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.367765:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027ae6e9c/0x9df728c939b7a395 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.367773:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027ae6e9c/0x9df728c939b7a395 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.367793:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050244.367794:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050244.367796:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789050244.384775:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789050244.385050:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050244.385062:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b7a39c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.385084:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1789050244.385090:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050244.385098:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b7a39c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.385116:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b7a39c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.385127:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b7a39c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.385135:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b7a39c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.385838:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789050244.386947:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050244.386959:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5cbdbba/0x9df728c939b7a3a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.387065:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1789050244.387073:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050244.387080:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5cbdbba/0x9df728c939b7a3a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.387097:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5cbdbba/0x9df728c939b7a3a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.387108:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5cbdbba/0x9df728c939b7a3a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.387116:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5cbdbba/0x9df728c939b7a3a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.387842:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789050244.388073:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050244.388083:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b7a39c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.388095:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330e00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050244.388101:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b7a39c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.388112:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b7a39c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.388134:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b7a39c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.388143:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ee41601/0x9df728c939b7a39c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.388184:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050244.388188:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5cbdbba/0x9df728c939b7a3a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.388195:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050244.388212:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5cbdbba/0x9df728c939b7a3a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.388221:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5cbdbba/0x9df728c939b7a3a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.388233:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5cbdbba/0x9df728c939b7a3a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.388241:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5cbdbba/0x9df728c939b7a3a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.388255:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.388257:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.388259:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050244.390391:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050244.390407:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a12b06c/0x9df728c939b7a3aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.390453:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1789050244.390458:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.390997:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050244.393373:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a12b06c/0x9df728c939b7a3aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.393411:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a12b06c/0x9df728c939b7a3aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.393442:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a12b06c/0x9df728c939b7a3aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.393451:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a12b06c/0x9df728c939b7a3aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.393479:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789050244.393501:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050244.393902:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a12b06c/0x9df728c939b7a3aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.393912:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331800 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050244.393916:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a12b06c/0x9df728c939b7a3aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.393927:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a12b06c/0x9df728c939b7a3aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.393949:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a12b06c/0x9df728c939b7a3aa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.393957:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a12b06c/0x9df728c939b7a3aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.393982:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050244.394063:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050244.394066:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050244.395440:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.395451:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a3b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.395469:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.395475:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.395482:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a3b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.395497:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a3b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.395506:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a3b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.395515:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a3b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.395544:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050244.395781:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050244.395790:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a3b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.395799:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050244.395812:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a3b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.395822:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a3b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.395840:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a3b1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.395848:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a3b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.395871:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.395873:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.395875:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050244.395987:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.395993:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6abc74b/0x9df728c939b7a3b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.396003:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.396006:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.396010:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6abc74b/0x9df728c939b7a3b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.396035:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6abc74b/0x9df728c939b7a3b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.396044:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6abc74b/0x9df728c939b7a3b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.396052:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6abc74b/0x9df728c939b7a3b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.396077:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789050244.396522:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.396529:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d02f6a71/0x9df728c939b7a3bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.396538:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.396542:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.396546:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d02f6a71/0x9df728c939b7a3bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.396556:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d02f6a71/0x9df728c939b7a3bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.396564:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d02f6a71/0x9df728c939b7a3bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.396594:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d02f6a71/0x9df728c939b7a3bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.396617:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789050244.397009:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.397015:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004bb3ef8/0x9df728c939b7a3c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.397023:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.397027:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.397030:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004bb3ef8/0x9df728c939b7a3c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.397039:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004bb3ef8/0x9df728c939b7a3c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.397047:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004bb3ef8/0x9df728c939b7a3c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.397055:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004bb3ef8/0x9df728c939b7a3c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.397064:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789050244.398378:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789050244.398391:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6abc74b/0x9df728c939b7a3b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.398404:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50800 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050244.398409:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6abc74b/0x9df728c939b7a3b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.398421:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6abc74b/0x9df728c939b7a3b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.398442:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6abc74b/0x9df728c939b7a3b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.398466:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6abc74b/0x9df728c939b7a3b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.398493:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050244.398496:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d02f6a71/0x9df728c939b7a3bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.398503:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50e00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050244.398506:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d02f6a71/0x9df728c939b7a3bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.398515:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d02f6a71/0x9df728c939b7a3bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.398525:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d02f6a71/0x9df728c939b7a3bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.398532:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d02f6a71/0x9df728c939b7a3bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.398545:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050244.398549:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004bb3ef8/0x9df728c939b7a3c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.398556:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51800 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050244.398565:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004bb3ef8/0x9df728c939b7a3c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.398573:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004bb3ef8/0x9df728c939b7a3c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.398595:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004bb3ef8/0x9df728c939b7a3c6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.398612:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004bb3ef8/0x9df728c939b7a3c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.398626:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.398628:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.398629:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.398639:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050244.401423:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.401441:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0d58e18/0x9df728c939b7a3cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.401470:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.401475:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.401483:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0d58e18/0x9df728c939b7a3cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.401501:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0d58e18/0x9df728c939b7a3cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.401513:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0d58e18/0x9df728c939b7a3cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.401521:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0d58e18/0x9df728c939b7a3cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.401548:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050244.401752:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050244.401761:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0d58e18/0x9df728c939b7a3cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.401770:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050244.401775:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0d58e18/0x9df728c939b7a3cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.401786:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0d58e18/0x9df728c939b7a3cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.401804:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0d58e18/0x9df728c939b7a3cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.401820:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0d58e18/0x9df728c939b7a3cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.401842:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.401843:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.401845:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050244.403495:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.403509:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b312a5e3/0x9df728c939b7a3d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.403526:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.403532:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.403539:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b312a5e3/0x9df728c939b7a3d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.403555:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b312a5e3/0x9df728c939b7a3d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.403579:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b312a5e3/0x9df728c939b7a3d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.403600:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b312a5e3/0x9df728c939b7a3d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.403620:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789050244.404150:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.404157:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b7a3db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.404168:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.404171:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.404176:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b7a3db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.404188:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b7a3db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.404228:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b7a3db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.404237:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b7a3db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.404271:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789050244.404288:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789050244.404295:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b312a5e3/0x9df728c939b7a3d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.404303:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050244.404308:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b312a5e3/0x9df728c939b7a3d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.404320:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b312a5e3/0x9df728c939b7a3d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.404339:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b312a5e3/0x9df728c939b7a3d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.404348:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b312a5e3/0x9df728c939b7a3d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.404369:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050244.404373:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b7a3db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.404380:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50a00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050244.404383:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b7a3db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.404403:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b7a3db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.404414:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b7a3db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.404421:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b7a3db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.404435:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050244.404437:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050244.404439:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050244.404869:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.404876:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007704dfad/0x9df728c939b7a3e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.404887:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.404891:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.404895:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007704dfad/0x9df728c939b7a3e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.405487:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050244.406752:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007704dfad/0x9df728c939b7a3e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.406775:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007704dfad/0x9df728c939b7a3e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.406792:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007704dfad/0x9df728c939b7a3e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.406854:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789050244.407609:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.407619:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a3e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.407635:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.407640:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.407647:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a3e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.407660:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a3e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.407667:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a3e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.407674:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a3e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.410122:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789050244.410476:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050244.410487:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007704dfad/0x9df728c939b7a3e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.410502:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050244.410508:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007704dfad/0x9df728c939b7a3e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.410521:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007704dfad/0x9df728c939b7a3e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.410545:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007704dfad/0x9df728c939b7a3e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.410554:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007704dfad/0x9df728c939b7a3e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.410579:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050244.410594:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a3e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.411013:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050244.411017:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a3e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.411026:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a3e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.411038:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a3e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.411047:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a3e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.411136:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.411138:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.411140:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.411156:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050244.414412:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.414428:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b7a3f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.414458:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.414464:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.414471:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b7a3f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.414489:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b7a3f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.414500:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b7a3f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.414508:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b7a3f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.414538:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050244.414559:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050244.414566:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b7a3f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.414574:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050244.414579:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b7a3f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.414609:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b7a3f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.414641:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b7a3f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.414649:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000636ddd63/0x9df728c939b7a3f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.414670:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050244.414672:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050244.414674:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050244.423534:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.423554:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004bb3ef8/0x9df728c939b7a3f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.423575:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.423591:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.423599:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004bb3ef8/0x9df728c939b7a3f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.423617:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004bb3ef8/0x9df728c939b7a3f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.423629:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004bb3ef8/0x9df728c939b7a3f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.423638:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004bb3ef8/0x9df728c939b7a3f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.423675:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789050244.424260:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.424267:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d02f6a71/0x9df728c939b7a3fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.424278:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.424282:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.424287:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d02f6a71/0x9df728c939b7a3fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.424299:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d02f6a71/0x9df728c939b7a3fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.424306:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d02f6a71/0x9df728c939b7a3fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.424314:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d02f6a71/0x9df728c939b7a3fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.424333:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789050244.424350:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789050244.424356:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004bb3ef8/0x9df728c939b7a3f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.424365:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51800 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050244.424378:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004bb3ef8/0x9df728c939b7a3f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.424388:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004bb3ef8/0x9df728c939b7a3f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.424409:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004bb3ef8/0x9df728c939b7a3f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.424417:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004bb3ef8/0x9df728c939b7a3f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.424436:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050244.424440:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d02f6a71/0x9df728c939b7a3fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.424447:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50e00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050244.424451:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d02f6a71/0x9df728c939b7a3fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.424458:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d02f6a71/0x9df728c939b7a3fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.424468:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d02f6a71/0x9df728c939b7a3fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.424476:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d02f6a71/0x9df728c939b7a3fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.424496:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050244.424498:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050244.424500:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050244.424960:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.424967:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6abc74b/0x9df728c939b7a405 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.424978:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.424981:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.424986:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6abc74b/0x9df728c939b7a405 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.424996:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6abc74b/0x9df728c939b7a405 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.425004:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6abc74b/0x9df728c939b7a405 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.425011:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6abc74b/0x9df728c939b7a405 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.425038:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789050244.425367:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050244.425375:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6abc74b/0x9df728c939b7a405 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.425385:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50800 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050244.425389:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6abc74b/0x9df728c939b7a405 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.425398:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6abc74b/0x9df728c939b7a405 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.425413:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6abc74b/0x9df728c939b7a405 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.425422:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6abc74b/0x9df728c939b7a405 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050244.425440:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050244.425442:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050244.425444:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.425805:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050244.434521:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.434539:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b7a40c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.434591:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.434599:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.434608:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b7a40c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.434627:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b7a40c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.434642:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b7a40c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.434655:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b7a40c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.434742:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789050244.435433:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.435442:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b312a5e3/0x9df728c939b7a413 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.435455:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.435460:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.435465:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b312a5e3/0x9df728c939b7a413 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.435478:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b312a5e3/0x9df728c939b7a413 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.435501:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b312a5e3/0x9df728c939b7a413 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.435510:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b312a5e3/0x9df728c939b7a413 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.435773:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050244.435784:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b7a40c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.435794:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50a00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050244.435800:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b7a40c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.435825:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b7a40c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.435848:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b7a40c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.435857:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ea2a9c8/0x9df728c939b7a40c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.436022:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789050244.436642:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.436651:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a41a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.436667:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.436672:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.436678:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a41a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.436693:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a41a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.436703:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a41a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.436712:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a41a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.436732:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789050244.437036:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050244.437044:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b312a5e3/0x9df728c939b7a413 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.437052:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050244.437056:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b312a5e3/0x9df728c939b7a413 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.437066:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b312a5e3/0x9df728c939b7a413 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.437081:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b312a5e3/0x9df728c939b7a413 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.437088:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b312a5e3/0x9df728c939b7a413 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.437115:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050244.437119:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a41a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.437126:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050244.437129:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a41a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.437137:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a41a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.437148:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a41a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.437156:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5e561ab/0x9df728c939b7a41a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.437168:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.437170:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.437172:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050244.437546:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.437554:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a421 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.437564:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.437568:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.437573:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a421 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.437597:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a421 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.437606:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a421 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.437613:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a421 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.437635:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050244.438316:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050244.438324:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a421 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.438335:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050244.438346:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a421 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.438357:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a421 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.438372:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a421 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.438380:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e25c5f1c/0x9df728c939b7a421 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.438397:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.438399:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.438401:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050244.439172:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.439182:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007704dfad/0x9df728c939b7a428 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.439726:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.439742:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.439752:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007704dfad/0x9df728c939b7a428 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.439776:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007704dfad/0x9df728c939b7a428 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.439788:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007704dfad/0x9df728c939b7a428 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.439797:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007704dfad/0x9df728c939b7a428 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.439814:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050244.440328:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050244.440337:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007704dfad/0x9df728c939b7a428 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.440348:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050244.440352:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007704dfad/0x9df728c939b7a428 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.440363:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007704dfad/0x9df728c939b7a428 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.440382:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007704dfad/0x9df728c939b7a428 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.440398:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007704dfad/0x9df728c939b7a428 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.440420:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.440422:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.440424:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050244.441360:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050244.441365:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050244.441367:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789050244.441446:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050244.441457:0:19617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0d58e18/0x9df728c939b7a42f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.441474:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1789050244.441480:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050244.441486:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0d58e18/0x9df728c939b7a42f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.441503:0:19617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0d58e18/0x9df728c939b7a42f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.441514:0:19617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0d58e18/0x9df728c939b7a42f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.441530:0:19617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0d58e18/0x9df728c939b7a42f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050244.441545:0:19617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050244.442137:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050244.442157:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0d58e18/0x9df728c939b7a42f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.442166:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050244.442171:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0d58e18/0x9df728c939b7a42f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.442181:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0d58e18/0x9df728c939b7a42f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.442221:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0d58e18/0x9df728c939b7a42f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.442229:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0d58e18/0x9df728c939b7a42f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050244.442370:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.442372:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050244.442374:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789050244.447765:0:19617:0:(ofd_dev.c:1524:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1789050244.447911:0:19617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18955:x1875954704175360:12345-0@lo:5:osp-pre-0-0.0 Request processed in 132235us (132323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050244.447941:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789050244.448692:0:18955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c271880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18955:1875954704175360:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789050244.448715:0:18955:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1789050244.448778:0:18955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c02aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18955:1875954704175488:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789050244.448854:0:18955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050244.448907:0:18955:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070635de40 going to sleep for 11 seconds 00000100:00100000:2.0:1789050244.449407:0:19616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704175488 00000100:00100000:2.0:1789050244.449416:0:19616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704175488 00000100:00100000:2.0:1789050244.449482:0:19616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789050244.449493:0:19616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:18955:x1875954704175488:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789050244.449555:0:19616:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00000100:00100000:2.0:1789050244.458659:0:19616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:18955:x1875954704175488:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9156us (9793us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1789050244.458675:0:19616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789050244.459309:0:18955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c02aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18955:1875954704175488:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789050244.459331:0:18955:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00010000:00010000:0.0:1789050244.706946:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050245.710073:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789050245.844152:0:20332:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789050245.844156:0:20332:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1789050245.844292:0:20332:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9506059ea800 00000020:01000004:0.0:1789050245.844307:0:20332:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789050245.844330:0:20332:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1789050245.844343:0:20332:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff950706404d40) 00000020:00000080:0.0:1789050245.844356:0:20332:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789050245.868732:0:20332:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789050245.868951:0:20332:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789050245.873832:0:20332:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789050245.876773:0:20332:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1789050245.877154:0:20332:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:1.0:1789050245.877879:0:20332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 591: rc = 0 00100000:10000000:1.0:1789050245.880538:0:20332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 591: rc = 0 00100000:10000000:1.0:1789050245.880650:0:20332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 591: rc = 0 00100000:10000000:1.0:1789050245.883157:0:20332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 13: rc = 0 00100000:10000000:1.0:1789050245.884121:0:20332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 13: rc = 0 00100000:10000000:1.0:1789050245.884637:0:20332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 13: rc = 0 00100000:10000000:1.0:1789050245.884943:0:20332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 13: rc = 0 00100000:10000000:1.0:1789050245.885539:0:20332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 13: rc = 0 00100000:10000000:1.0:1789050245.885803:0:20332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 13: rc = 0 00000020:00000080:3.0:1789050245.890165:0:20332:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789050245.890371:0:20332:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789050245.890383:0:20332:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9df728c939b7a43d 00000020:01000004:3.0:1789050245.890392:0:20332:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789050245.890410:0:20332:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.101@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789050245.890413:0:20332:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789050245.890418:0:20332:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789050245.890515:0:20332:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789050245.890520:0:20332:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789050245.916935:0:20332:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.101@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789050245.917551:0:20332:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.101@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789050245.917556:0:20332:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789050245.917558:0:20332:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789050245.917559:0:20332:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789050245.917560:0:20332:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789050245.917562:0:20332:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789050245.917563:0:20332:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789050245.917564:0:20332:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789050245.917566:0:20332:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789050245.917567:0:20332:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789050245.917571:0:20332:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789050245.917584:0:20332:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789050245.917585:0:20332:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789050245.917586:0:20332:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789050245.917587:0:20332:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789050245.917588:0:20332:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789050245.917589:0:20332:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789050245.917590:0:20332:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789050245.917592:0:20332:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789050245.917593:0:20332:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789050245.917629:0:20332:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789050245.917650:0:20332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c270e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704175616:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789050245.917719:0:20332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050245.917832:0:20332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507012540c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050245.920473:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704175616 00000100:00100000:0.0:1789050245.920487:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704175616 00000100:00100000:1.0:1789050245.920660:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789050245.920670:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:20332:x1875954704175616:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789050245.920720:0:18925:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789050245.920724:0:18925:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789050245.920728:0:18925:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789050245.956782:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:20332:x1875954704175616:12345-0@lo:253:mount.lustre.0 Request processed in 36100us (39050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050245.956801:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789050245.960436:0:20332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c270e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704175616:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789050245.960465:0:20332:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789050245.960468:0:20332:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789050245.960470:0:20332:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789050245.960472:0:20332:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789050245.960473:0:20332:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789050245.960475:0:20332:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789050245.960476:0:20332:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789050245.960478:0:20332:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789050245.960501:0:20332:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789050245.960502:0:20332:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789050245.960535:0:20332:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9506059ea800 from lustre-OST0001 10000000:01000000:3.0:1789050245.960584:0:20332:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789050245.960588:0:20332:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789050245.960598:0:20332:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff950704423380 local copy 00010000:00010000:3.0:1789050245.960610:0:20332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7a1c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a1ce expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050245.961343:0:20332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c270e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704175744:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050245.961424:0:20332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050245.961552:0:20332:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdf840 going to sleep for 11 seconds 00000100:00100000:0.0:1789050245.962630:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704175744 00000100:00100000:0.0:1789050245.962645:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704175744 00000100:00100000:0.0:1789050245.962733:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789050245.962746:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:20332:x1875954704175744:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789050245.963486:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:20332:x1875954704175744:12345-0@lo:501:mount.lustre.0 Request processed in 739us (2058us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789050245.963509:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789050245.967723:0:20332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c270e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704175744:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789050245.967766:0:20332:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789050245.968397:0:20332:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789050245.968410:0:20332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7a1c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a1ce expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050245.968422:0:20332:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff95073bc0e400/0x9df728c939b7a1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a1ce expref: -99 pid: 18914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050245.968457:0:20332:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9506059ea800 10000000:01000000:3.0:1789050245.968461:0:20332:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789050245.968467:0:20332:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789050245.968470:0:20332:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789050245.968475:0:20332:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789050245.968478:0:20332:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789050245.968519:0:20332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331800/0x9df728c939b7a444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050245.968539:0:20332:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950703331800/0x9df728c939b7a444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050245.968553:0:20332:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950703331800/0x9df728c939b7a444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050245.968590:0:20332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c270e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704175872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789050245.969953:0:20332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050245.970028:0:20332:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdf840 going to sleep for 11 seconds 00000100:00100000:0.0:1789050245.970866:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704175872 00000100:00100000:0.0:1789050245.970880:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704175872 00000100:00100000:0.0:1789050245.970967:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789050245.970979:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:20332:x1875954704175872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789050245.970999:0:18925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050245.971021:0:18925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950605f06400/0x9df728c939b7a44b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7a444 expref: -99 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050245.971054:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950605f06400/0x9df728c939b7a44b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7a444 expref: 17 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050245.971068:0:18925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950605f06400/0x9df728c939b7a44b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a444 expref: 17 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050245.971078:0:18925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06400, rc 0) 00000100:00100000:0.0:1789050245.971387:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+17:20332:x1875954704175872:12345-0@lo:101:mount.lustre.0 Request processed in 408us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050245.971395:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789050245.971993:0:20332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c270e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704175872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050245.972019:0:20332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950703331800/0x9df728c939b7a444 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a44b expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050245.972031:0:20332:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950703331800/0x9df728c939b7a444 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7a44b expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789050245.973961:0:20332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1789050245.975655:0:20332:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789050245.976328:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789050245.976392:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1789050245.976429:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1789050245.977499:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1789050245.977571:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1789050245.977624:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1789050245.977686:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1789050245.977726:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1789050245.977777:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1789050245.977871:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1789050245.977898:0:20332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1789050245.978027:0:20332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c270e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704176000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050245.978108:0:20332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050245.978411:0:20332:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704fdfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789050245.985282:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704176000 00000100:00100000:2.0:1789050245.985305:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704176000 00000100:00100000:2.0:1789050245.985392:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789050245.985403:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+17:20332:x1875954704176000:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050245.987416:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+17:20332:x1875954704176000:12345-0@lo:501:mount.lustre.0 Request processed in 2002us (9295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050245.987433:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789050245.988858:0:20332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c270e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704176000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050245.988951:0:20332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c516d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704176128:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050245.989050:0:20332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050245.989100:0:20332:0:(client.c:2716:ptlrpc_set_wait()) set ffff950701359240 going to sleep for 11 seconds 00000100:00100000:2.0:1789050245.989931:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704176128 00000100:00100000:2.0:1789050245.989944:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704176128 00000100:00100000:2.0:1789050245.990070:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789050245.990082:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+17:20332:x1875954704176128:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789050245.991815:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+17:20332:x1875954704176128:12345-0@lo:503:mount.lustre.0 Request processed in 1725us (2755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050245.991830:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789050245.992112:0:20332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c516d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704176128:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789050245.995125:0:20332:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789050245.995486:0:20332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c516d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704176256:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050245.995619:0:20332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050246.000029:0:20332:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070a9e10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050246.000809:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704176256 00000100:00100000:0.0:1789050246.000824:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704176256 00000100:00100000:0.0:1789050246.006521:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789050246.006539:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+17:20332:x1875954704176256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789050246.007326:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+17:20332:x1875954704176256:12345-0@lo:502:mount.lustre.0 Request processed in 789us (11705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050246.007339:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789050246.007808:0:20332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c516d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704176256:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789050246.018560:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789050246.018714:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1789050246.018752:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1789050246.018812:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1789050246.018868:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1789050246.018905:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1789050246.018957:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1789050246.018995:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1789050246.019043:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1789050246.019110:0:20332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c516d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704176384:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789050246.019268:0:20332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050246.019315:0:20332:0:(client.c:2716:ptlrpc_set_wait()) set ffff950701359240 going to sleep for 11 seconds 00000100:00100000:0.0:1789050246.023638:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704176384 00000100:00100000:0.0:1789050246.023693:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704176384 00000100:00100000:0.0:1789050246.023787:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789050246.023801:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+17:20332:x1875954704176384:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789050246.026117:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+17:20332:x1875954704176384:12345-0@lo:502:mount.lustre.0 Request processed in 2307us (6837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050246.026133:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789050246.026349:0:20332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c516d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704176384:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789050246.026491:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1789050246.026508:0:20332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1789050246.028196:0:20333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789050246.028367:0:20333:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789050246.028375:0:20333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789050246.028378:0:20333:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789050246.028385:0:20333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789050246.028404:0:20333:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff95070345b380) 00000020:00000080:3.0:1789050246.028463:0:20333:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789050246.028472:0:20333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789050246.028548:0:20333:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9506059ea800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789050246.028557:0:20333:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789050246.028565:0:20333:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9df728c939b7a459 00010000:00010000:3.0:1789050246.037472:0:20333:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1789050246.038543:0:20333:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934598 00080000:10000000:3.0:1789050246.046684:0:20333:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:0.0:1789050246.051002:0:20333:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789050246.051019:0:20333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050246.051026:0:20333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050246.051029:0:20333:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789050246.051033:0:20333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050246.051038:0:20333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050246.051040:0:20333:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789050246.051043:0:20333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789050246.051045:0:20333:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789050246.051047:0:20333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050246.051050:0:20333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050246.051051:0:20333:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789050246.051054:0:20333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789050246.051057:0:20333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050246.051058:0:20333:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789050246.051061:0:20333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789050246.051142:0:20333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789050246.051161:0:20333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789050246.051163:0:20333:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789050246.051167:0:20333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1789050246.051779:0:20332:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789050246.051821:0:20332:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789050246.051846:0:20332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331800/0x9df728c939b7a444 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a44b expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050246.051861:0:20332:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950703331800/0x9df728c939b7a444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a44b expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050246.051871:0:20332:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9506059ea800 from 1 10000000:01000000:2.0:1789050246.051874:0:20332:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789050246.051922:0:20332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c51600/0x9df728c939b7a460 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050246.051931:0:20332:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950702c51600/0x9df728c939b7a460 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050246.051944:0:20332:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950702c51600/0x9df728c939b7a460 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050246.051975:0:20332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704176512:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789050246.052063:0:20332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050246.052107:0:20332:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704e98480 going to sleep for 11 seconds 00000100:00100000:2.0:1789050246.053479:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704176512 00000100:00100000:2.0:1789050246.053492:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704176512 00000100:00100000:2.0:1789050246.053567:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789050246.053588:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+17:20332:x1875954704176512:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050246.053608:0:18926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050246.053628:0:18926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950702c51800/0x9df728c939b7a467 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7a460 expref: -99 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050246.053669:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950702c51800/0x9df728c939b7a467 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7a460 expref: 18 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050246.053683:0:18926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950702c51800/0x9df728c939b7a467 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a460 expref: 18 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050246.053692:0:18926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c51800, rc 0) 00000100:00100000:2.0:1789050246.053778:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+18:20332:x1875954704176512:12345-0@lo:101:mount.lustre.0 Request processed in 192us (1715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050246.053785:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789050246.053855:0:20332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704176512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050246.053875:0:20332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950702c51600/0x9df728c939b7a460 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a467 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050246.053885:0:20332:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950702c51600/0x9df728c939b7a460 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7a467 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789050246.054603:0:20332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:2.0:1789050246.055336:0:20332:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789050246.055633:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1789050246.055696:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1789050246.055748:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1789050246.055785:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1789050246.055834:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1789050246.055883:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1789050246.055921:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1789050246.055956:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1789050246.056025:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1789050246.056033:0:20332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:2.0:1789050246.056151:0:20332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704176640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050246.059862:0:20332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050246.059950:0:20332:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704e98480 going to sleep for 11 seconds 00000100:00100000:1.0:1789050246.060145:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704176640 00000100:00100000:1.0:1789050246.060167:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704176640 00000100:00100000:1.0:1789050246.060262:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789050246.060273:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+18:20332:x1875954704176640:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789050246.062455:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+18:20332:x1875954704176640:12345-0@lo:501:mount.lustre.0 Request processed in 2171us (6174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050246.062472:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789050246.062906:0:20332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704176640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050246.062982:0:20332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704176768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789050246.063658:0:20332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050246.063870:0:20332:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704e98480 going to sleep for 11 seconds 00000100:00100000:1.0:1789050246.065081:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704176768 00000100:00100000:1.0:1789050246.065095:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704176768 00000100:00100000:1.0:1789050246.065163:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789050246.065270:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+18:20332:x1875954704176768:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789050246.066246:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+18:20332:x1875954704176768:12345-0@lo:503:mount.lustre.0 Request processed in 1067us (2583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050246.066260:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789050246.066933:0:20332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704176768:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789050246.068950:0:20332:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789050246.070512:0:20332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704176896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050246.070644:0:20332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050246.070742:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704176896 00000100:00100000:1.0:1789050246.070752:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704176896 00000100:00100000:1.0:1789050246.070817:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789050246.070827:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+18:20332:x1875954704176896:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050246.071300:0:20332:0:(client.c:2716:ptlrpc_set_wait()) set ffff950713fe8780 going to sleep for 11 seconds 00000100:00100000:1.0:1789050246.071781:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+18:20332:x1875954704176896:12345-0@lo:502:mount.lustre.0 Request processed in 951us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050246.071792:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789050246.071825:0:20332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704176896:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789050246.073597:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789050246.074469:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1789050246.074564:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1789050246.074633:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1789050246.075282:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1789050246.075661:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1789050246.077248:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1789050246.077319:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:3.0:1789050246.077390:0:20332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c270a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704177024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050246.077503:0:20332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050246.077564:0:20332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507090ab000 going to sleep for 11 seconds 00000100:00100000:2.0:1789050246.077678:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704177024 00000100:00100000:2.0:1789050246.077746:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704177024 00000100:00100000:2.0:1789050246.078094:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789050246.078108:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+18:20332:x1875954704177024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050246.080459:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+18:20332:x1875954704177024:12345-0@lo:502:mount.lustre.0 Request processed in 2341us (2944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050246.080478:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789050246.080540:0:20332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c270a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704177024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789050246.081047:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1789050246.081066:0:20332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1789050246.094127:0:20337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050246.094145:0:20337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050246.094148:0:20337:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789050246.094158:0:20337:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9506059ea800 00000020:00000080:2.0:1789050246.094162:0:20337:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789050246.094169:0:20337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050246.094172:0:20337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050246.094173:0:20337:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789050246.094176:0:20337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050246.094178:0:20337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050246.094180:0:20337:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789050246.094183:0:20337:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9506059ea800 00000020:00000080:2.0:1789050246.094185:0:20337:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789050246.094293:0:20337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050246.094297:0:20337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050246.094299:0:20337:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789050246.094301:0:20337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789050246.094304:0:20337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050246.094305:0:20337:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789050246.094309:0:20337:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9506059ea800 00000020:00000080:2.0:1789050246.094311:0:20337:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789050246.094469:0:20337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789050246.094473:0:20337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789050246.094474:0:20337:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789050246.094477:0:20337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:3.0:1789050246.094610:0:20332:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789050246.094646:0:20332:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789050246.094682:0:20332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950702c51600/0x9df728c939b7a460 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a467 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050246.094723:0:20332:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950702c51600/0x9df728c939b7a460 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a467 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789050246.094780:0:20332:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789050246.094784:0:20332:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9506059ea800 10000000:01000000:3.0:1789050246.094788:0:20332:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9506059ea800 10000000:01000000:3.0:1789050246.094792:0:20332:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789050246.094799:0:20332:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9506059ea800 from 1 10000000:01000000:3.0:1789050246.094802:0:20332:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789050246.094987:0:20332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b7a46e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050246.094997:0:20332:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b7a46e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050246.095012:0:20332:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b7a46e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050246.095045:0:20332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c273480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704177152:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789050246.095134:0:20332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050246.095276:0:20332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507090ab0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050246.095517:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704177152 00000100:00100000:2.0:1789050246.095538:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704177152 00000100:00100000:2.0:1789050246.095615:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789050246.095628:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+18:20332:x1875954704177152:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789050246.095645:0:18926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050246.095670:0:18926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950702c50e00/0x9df728c939b7a475 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7a46e expref: -99 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050246.095701:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950702c50e00/0x9df728c939b7a475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7a46e expref: 19 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050246.095714:0:18926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950702c50e00/0x9df728c939b7a475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a46e expref: 19 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050246.095725:0:18926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950702c50e00, rc 0) 00000100:00100000:2.0:1789050246.095783:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:20332:x1875954704177152:12345-0@lo:101:mount.lustre.0 Request processed in 158us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050246.095792:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789050246.096015:0:20332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c273480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704177152:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789050246.096032:0:20332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b7a46e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a475 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050246.096043:0:20332:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b7a46e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7a475 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789050246.098026:0:20332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:3.0:1789050246.098662:0:20332:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789050246.099002:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1789050246.099057:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1789050246.099100:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1789050246.099156:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1789050246.099196:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1789050246.099283:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1789050246.099324:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1789050246.099361:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1789050246.099413:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1789050246.099449:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1789050246.099482:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1789050246.099531:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1789050246.099587:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1789050246.099631:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1789050246.099689:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1789050246.099725:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1789050246.099763:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1789050246.099812:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1789050246.099852:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1789050246.099892:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1789050246.102484:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1789050246.102625:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1789050246.102664:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1789050246.102750:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1789050246.102789:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:3.0:1789050246.102825:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:3.0:1789050246.104140:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:3.0:1789050246.105127:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:3.0:1789050246.105240:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:3.0:1789050246.105334:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:3.0:1789050246.105369:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:3.0:1789050246.105401:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:3.0:1789050246.105433:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:3.0:1789050246.105480:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:3.0:1789050246.105516:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:3.0:1789050246.105561:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:3.0:1789050246.105609:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:3.0:1789050246.105645:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:3.0:1789050246.105697:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:3.0:1789050246.105735:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:3.0:1789050246.106034:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:3.0:1789050246.106044:0:20332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:3.0:1789050246.106186:0:20332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c273480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704177280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050246.106424:0:20332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050246.106529:0:20332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507090ab0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050246.106934:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704177280 00000100:00100000:2.0:1789050246.106945:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704177280 00000100:00100000:2.0:1789050246.107051:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789050246.107064:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:20332:x1875954704177280:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789050246.107460:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:20332:x1875954704177280:12345-0@lo:501:mount.lustre.0 Request processed in 397us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050246.107471:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789050246.113379:0:20332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c273480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704177280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789050246.113461:0:20332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c273480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704177408:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789050246.113559:0:20332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050246.113625:0:20332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507090ab0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789050246.113708:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704177408 00000100:00100000:2.0:1789050246.113717:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704177408 00000100:00100000:2.0:1789050246.113785:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789050246.113797:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:20332:x1875954704177408:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789050246.114139:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:20332:x1875954704177408:12345-0@lo:503:mount.lustre.0 Request processed in 345us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050246.114284:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789050246.115526:0:20332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c273480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704177408:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789050246.117531:0:20332:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789050246.117692:0:20332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c273480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704177536:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050246.117793:0:20332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050246.117850:0:20332:0:(client.c:2716:ptlrpc_set_wait()) set ffff950703288e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789050246.118036:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704177536 00000100:00100000:2.0:1789050246.118046:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704177536 00000100:00100000:2.0:1789050246.118102:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789050246.118113:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:20332:x1875954704177536:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789050246.118456:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:20332:x1875954704177536:12345-0@lo:502:mount.lustre.0 Request processed in 343us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050246.118465:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789050246.118836:0:20332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c273480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704177536:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789050246.119595:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1789050246.119674:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1789050246.119712:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1789050246.119771:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1789050246.119817:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1789050246.123439:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1789050246.123545:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1789050246.123594:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1789050246.123660:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1789050246.123698:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1789050246.123731:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1789050246.125153:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1789050246.125280:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1789050246.125320:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1789050246.125376:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1789050246.125413:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1789050246.125472:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1789050246.125523:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1789050246.125562:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1789050246.125609:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1789050246.125660:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1789050246.125697:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1789050246.125733:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1789050246.125783:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1789050246.125819:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:3.0:1789050246.127765:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:3.0:1789050246.127918:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:3.0:1789050246.127957:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:3.0:1789050246.127994:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:3.0:1789050246.128047:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:3.0:1789050246.128088:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:3.0:1789050246.128129:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:3.0:1789050246.128223:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:3.0:1789050246.128309:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:3.0:1789050246.128376:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:3.0:1789050246.128451:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:3.0:1789050246.128512:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:3.0:1789050246.128566:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:3.0:1789050246.128638:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:3.0:1789050246.128674:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:3.0:1789050246.128736:0:20332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c273480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704177664:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050246.128841:0:20332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050246.128919:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704177664 00000100:00100000:3.0:1789050246.128929:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704177664 00000100:00100000:3.0:1789050246.128992:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789050246.129002:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:20332:x1875954704177664:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789050246.129319:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:20332:x1875954704177664:12345-0@lo:502:mount.lustre.0 Request processed in 318us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050246.129329:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789050246.129394:0:20332:0:(client.c:2716:ptlrpc_set_wait()) set ffff950703288e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789050246.129422:0:20332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c273480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704177664:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789050246.129517:0:20332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:3.0:1789050246.129529:0:20332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789050246.134783:0:20342:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789050246.134811:0:20342:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff950704ff99c0) 00000020:00000080:2.0:1789050246.135047:0:20342:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1789050246.135332:0:20342:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9506059ea800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789050246.135338:0:20342:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9506059ea800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789050246.135341:0:20342:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9506059ea800 3 00010000:00080000:2.0:1789050246.135385:0:20342:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95073f2da000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.101@tcp at head 00010000:00010000:3.0:1789050246.138557:0:20342:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1789050246.139071:0:20342:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789050246.139120:0:20342:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789050246.139136:0:20342:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9df728c939b7a483 00000100:00080000:3.0:1789050246.139565:0:20342:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789050246.139594:0:20342:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff95073f2da000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:3.0:1789050246.140259:0:20342:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c273480 x1875954704177792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789050246.140295:0:20342:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789050246.140361:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789050246.140366:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789050246.140369:0:8:0:(import.c:65:import_set_state_nolock()) ffff9507039ef000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789050246.140374:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:3.0:1789050246.140380:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789050246.140388:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9507039ef000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:3.0:1789050246.140404:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c272a00 x1875954704178048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789050246.140464:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c271f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704177920:0@lo:400:kworker.0 00000100:00100000:3.0:1789050246.140545:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050246.142333:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704178304:0@lo:400:kworker.0 00000100:00100000:3.0:1789050246.142421:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050246.142477:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789050246.142486:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704178176:0@lo:400:kworker.0 00000100:00100000:3.0:1789050246.142509:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050246.142556:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704178304 00000100:00100000:3.0:1789050246.142565:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704178304 00000100:00100000:3.0:1789050246.142643:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704178176 00000100:00100000:3.0:1789050246.142647:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704178176 00000100:00100000:0.0:1789050246.142949:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3281:1875954704177792:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789050246.143013:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050246.143040:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704178048:0@lo:8:kworker.0 00000100:00100000:0.0:1789050246.143073:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789050246.143120:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050246.143134:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704177920 00000100:00100000:0.0:1789050246.143139:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704177920 00000100:00100000:0.0:1789050246.143178:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704178048 00000100:00100000:0.0:1789050246.143180:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704178048 00000100:00100000:0.0:1789050246.143191:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789050246.143216:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3285:x1875954704177920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050246.143248:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789050246.143262:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704178304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050246.143289:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3285:x1875954704177920:12345-0@lo:400:kworker.0 Request processed in 88us (2743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050246.143297:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789050246.143318:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789050246.143329:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875954704178304:12345-0@lo:400:kworker.0 Request processed in 70us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050246.143337:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789050246.143344:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3281:x1875954704178048:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789050246.143354:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704177792 00000100:00100000:3.0:1789050246.143359:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704177792 00000100:00100000:3.0:1789050246.143382:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789050246.143391:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704178176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050246.143403:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3281:x1875954704178048:12345-0@lo:8:kworker.0 Request processed in 77us (328us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789050246.143410:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789050246.143427:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050246.143434:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704178176:12345-0@lo:400:kworker.0 Request processed in 44us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050246.143442:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789050246.143458:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789050246.143463:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1789050246.143464:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3281:x1875954704177792:12345-0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789050246.143476:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9507039ef000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789050246.143482:0:3281:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00010000:00080000:3.0:1789050246.143486:0:18933:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 482 last 0 00000100:00100000:0.0:1789050246.143488:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704178048:0@lo:8:kworker.0 00000100:00100000:0.0:1789050246.143532:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c271f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704177920:0@lo:400:kworker.0 00000020:00000080:3.0:1789050246.143552:0:18933:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9df728c939b7a48a 00000004:00100000:3.0:1789050246.143582:0:18933:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789050246.143620:0:18933:0:(import.c:65:import_set_state_nolock()) ffff950737b7e000 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1789050246.144160:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95073c273480 x1875954704177792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789050256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050246.144172:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789050246.144180:0:3281:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1789050246.144188:0:3281:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789050246.144193:0:3281:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789050246.144225:0:3281:0:(import.c:65:import_set_state_nolock()) ffff95073f2da000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789050246.144233:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3281:1875954704177792:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789050246.144809:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875954704177792:12345-0@lo:38:llog_process_th.0 Request processed in 1340us (1791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050246.144821:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789050246.144891:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95073c272300 x1875954704178176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050246.144904:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704178176:0@lo:400:kworker.0 00010000:00080000:3.0:1789050246.144918:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95073c270a80 x1875954704178304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789050246.144926:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1875954704178304:0@lo:400:kworker.0 00000040:00080000:3.0:1789050246.145144:0:20342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:3.0:1789050246.145294:0:20332:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789050246.145321:0:20332:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789050246.145346:0:20332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b7a46e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a475 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050246.145369:0:20332:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950703331e00/0x9df728c939b7a46e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a475 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789050246.145422:0:20332:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789050246.145425:0:20332:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789050246.145427:0:20332:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789050246.145428:0:20332:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789050246.145429:0:20332:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789050246.145431:0:20332:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789050246.145434:0:20332:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789050246.145436:0:20332:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789050246.145437:0:20332:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789050246.145442:0:20332:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789050246.145444:0:20332:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789050246.145446:0:20332:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789050246.145447:0:20332:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789050246.145449:0:20332:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789050246.145450:0:20332:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789050246.145452:0:20332:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789050246.145453:0:20332:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789050246.145454:0:20332:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789050246.145455:0:20332:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789050246.145485:0:20332:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789050246.145503:0:20332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c270a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704178432:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789050246.145603:0:20332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050246.145648:0:20332:0:(client.c:2716:ptlrpc_set_wait()) set ffff950703288540 going to sleep for 11 seconds 00000100:00100000:0.0:1789050246.145909:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704178432 00000100:00100000:0.0:1789050246.145919:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704178432 00000100:00100000:0.0:1789050246.145972:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789050246.145982:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:20332:x1875954704178432:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789050246.146172:0:18925:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789050246.146191:0:18925:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789050246.212860:0:18925:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789050246.212882:0:18925:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789050246.212903:0:18948:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789050246.212910:0:18948:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789050246.212939:0:18948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff950702c51400/0x9df728c939b7a491 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050246.212962:0:18948:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950703331c00/0x9df728c939b7a348 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a341 expref: 19 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050246.212972:0:18948:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff950702c51400/0x9df728c939b7a491 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050246.213030:0:18948:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950703331c00/0x9df728c939b7a348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b7a341 expref: 19 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050246.213063:0:18948:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff950703331c00/0x9df728c939b7a348 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b7a341 expref: 19 pid: 18927 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050246.213081:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18948:1875954704178560:0@lo:104: 00000100:00100000:2.0:1789050246.213178:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050246.213290:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff950711bd93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050246.213436:0:18915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704178560 00000100:00100000:0.0:1789050246.213446:0:18915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704178560 00000100:00100000:0.0:1789050246.213501:0:18915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789050246.213513:0:18915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720826680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7878f230-1e80-42fc-b48c-88e089c8a2b3+3:18948:x1875954704178560:12345-0@lo:104: 00010000:00010000:0.0:1789050246.213537:0:18915:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950702c50c00/0x9df728c939b7a341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7a348 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050246.213611:0:18915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789050246.213618:0:18915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720826680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7878f230-1e80-42fc-b48c-88e089c8a2b3+3:18948:x1875954704178560:12345-0@lo:104: Request processed in 107us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050246.213626:0:18915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789050246.213648:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18948:1875954704178560:0@lo:104: 00010000:00010000:2.0:1789050246.213784:0:18948:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff950702c51400/0x9df728c939b7a491 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050246.214062:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050246.214070:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950702c50c00/0x9df728c939b7a341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7a348 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050246.214081:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50c00 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:1.0:1789050246.214086:0:18920:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950702c50c00/0x9df728c939b7a341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b7a348 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050246.214096:0:18920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950702c50c00/0x9df728c939b7a341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b7a348 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789050246.214105:0:18920:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950702c50c00/0x9df728c939b7a341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b7a348 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050246.214111:0:18920:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789050246.214154:0:18920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950702c50c00/0x9df728c939b7a341 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a348 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050246.214160:0:18920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789050246.214181:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950702c50c00/0x9df728c939b7a341 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a348 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050246.214188:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950702c50c00/0x9df728c939b7a341 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a348 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050246.214220:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7878f230-1e80-42fc-b48c-88e089c8a2b3:3284:1875954704178688:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789050246.214231:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050246.214234:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050246.214236:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050246.214269:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050246.214534:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704178688 00000100:00100000:1.0:1789050246.214541:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704178688 00010000:00010000:1.0:1789050246.214567:0:18919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950703331c00/0x9df728c939b7a348 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7a341 expref: 20 pid: 18927 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050246.214617:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789050246.214626:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720824000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7878f230-1e80-42fc-b48c-88e089c8a2b3+20:3284:x1875954704178688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789050246.214639:0:18919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050246.214645:0:18919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950703331c00/0x9df728c939b7a348 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7a341 expref: 20 pid: 18927 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050246.214655:0:18919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950703331c00/0x9df728c939b7a348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b7a341 expref: 20 pid: 18927 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050246.214677:0:18919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950703331c00/0x9df728c939b7a348 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b7a341 expref: 20 pid: 18927 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050246.214693:0:18919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff950702c51400/0x9df728c939b7a491 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050246.214702:0:18919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950702c51400/0x9df728c939b7a491 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789050246.214716:0:18919:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001807916s 00010000:00010000:1.0:1789050246.214721:0:18919:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950702c51400/0x9df728c939b7a491 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050246.214728:0:18919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950702c51400/0x9df728c939b7a491 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050246.214736:0:18919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff950702c51400/0x9df728c939b7a491 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050246.214742:0:18919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff950702c51400/0x9df728c939b7a491 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050246.214754:0:18919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050246.214759:0:18919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff950702c51400/0x9df728c939b7a491 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050246.214766:0:18919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff950702c51400/0x9df728c939b7a491 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050246.214786:0:18919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff950702c51400/0x9df728c939b7a491 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050246.214795:0:18919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050246.214837:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720824000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:3284:x1875954704178688:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050246.215021:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7878f230-1e80-42fc-b48c-88e089c8a2b3:3284:1875954704178688:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789050246.215079:0:18948:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff950702c51400/0x9df728c939b7a491 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050246.215090:0:18948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff950702c51400/0x9df728c939b7a491 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050246.215097:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950702c51400/0x9df728c939b7a491 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050246.215190:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789050246.241126:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+18:20332:x1875954704178432:12345-0@lo:253:mount.lustre.0 Request processed in 95132us (95510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050246.241145:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789050246.241803:0:20332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c270a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7878f230-1e80-42fc-b48c-88e089c8a2b3:20332:1875954704178432:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789050246.241825:0:20332:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789050246.241830:0:20332:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789050246.241831:0:20332:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789050246.241833:0:20332:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789050246.241835:0:20332:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789050246.241836:0:20332:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789050246.241837:0:20332:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789050246.241851:0:20332:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789050246.241853:0:20332:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789050246.241855:0:20332:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789050246.241879:0:20332:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789050246.244739:0:20332:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789050246.246875:0:20332:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789050246.247135:0:20332:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789050246.251632:0:20332:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789050246.252750:0:20332:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789050246.254215:0:20332:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789050246.255391:0:20332:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1789050246.389994:0:20332:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789050246.390008:0:20332:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789050246.390068:0:20332:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789050246.390157:0:20332:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789050246.390174:0:20332:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789050246.390265:0:20332:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1789050246.734727:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789050247.563419:0:18930:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789050247.563429:0:18930:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff95072f422000 from 11 10000000:01000000:0.0:1789050247.563434:0:18930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789050247.563498:0:18930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950605f06600/0x9df728c939b7a498 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050247.563530:0:18930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950605f06600/0x9df728c939b7a498 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050247.563544:0:18930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950605f06600/0x9df728c939b7a498 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050247.563593:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c028e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704178816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789050247.563683:0:18930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050247.563746:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9507032f9540 going to sleep for 11 seconds 00000100:00100000:3.0:1789050247.564051:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704178816 00000100:00100000:3.0:1789050247.564061:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704178816 00000100:00100000:3.0:1789050247.564133:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789050247.564149:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+18:18930:x1875954704178816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050247.564165:0:18926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050247.564182:0:18926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703330600/0x9df728c939b7a49f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7a498 expref: -99 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050247.564243:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703330600/0x9df728c939b7a49f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7a498 expref: 19 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050247.564270:0:18926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703330600/0x9df728c939b7a49f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a498 expref: 19 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050247.564280:0:18926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330600, rc 0) 00000100:00100000:3.0:1789050247.564332:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708781c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:18930:x1875954704178816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050247.564339:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789050247.564350:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c028e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704178816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050247.564368:0:18930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950605f06600/0x9df728c939b7a498 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a49f expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050247.564378:0:18930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950605f06600/0x9df728c939b7a498 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7a49f expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050247.564439:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720827100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704178944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789050247.564502:0:18930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050247.564528:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f3c540 going to sleep for 11 seconds 00000100:00100000:2.0:1789050247.564540:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704178944 00000100:00100000:2.0:1789050247.564544:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704178944 00000100:00100000:2.0:1789050247.564578:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789050247.564586:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:18930:x1875954704178944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789050247.564600:0:18925:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789050247.564619:0:18925:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789050247.564622:0:18925:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1789050247.564712:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708780850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:18930:x1875954704178944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050247.564718:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720827100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704178944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789050247.564719:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 10000000:01000000:3.0:1789050247.564789:0:18930:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789050247.564798:0:18930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950605f06600/0x9df728c939b7a498 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a49f expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050247.564807:0:18930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950605f06600/0x9df728c939b7a498 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a49f expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050247.756023:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789050247.996469:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789050247.996496:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00010000:00010000:1.0:1789050248.779957:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050249.364674:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789050249.364696:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704179072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050249.364758:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050249.364873:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704179072 00000100:00100000:3.0:1789050249.364882:0:19618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704179072 00000100:00100000:3.0:1789050249.364938:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789050249.364949:0:19618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704179072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789050249.364980:0:19618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789050249.365023:0:19618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704179072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050249.365029:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789050249.365152:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050249.365178:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1789050249.365227:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704179072:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789050249.804338:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050250.827580:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789050251.084757:0:18964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1789050251.405788:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789050251.405794:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789050251.405798:0:38:0:(import.c:65:import_set_state_nolock()) ffff9507039ef000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789050251.405814:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9507039ef000 using connection 192.168.206.101@tcp/0@lo 00000100:00100000:0.0:1789050251.405835:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95073c02b480 x1875954704179456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789050251.405898:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c02aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7878f230-1e80-42fc-b48c-88e089c8a2b3:3282:1875954704179200:0@lo:400:kworker.0 00000100:00100000:0.0:1789050251.405960:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050251.406018:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c02bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875954704179840:0@lo:400:kworker.0 00000100:00100000:0.0:1789050251.406041:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050251.406061:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050251.406065:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c02b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704179328:0@lo:400:kworker.0 00000100:00100000:0.0:1789050251.406084:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050251.406105:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c02b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704179456:0@lo:8:kworker.0 00000100:00100000:0.0:1789050251.406123:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050251.406142:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c028700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875954704179584:0@lo:400:kworker.0 00000100:00100000:0.0:1789050251.406159:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050251.406317:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704179840 00000100:00100000:3.0:1789050251.406329:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704179840 00000100:00100000:3.0:1789050251.406373:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704179584 00000100:00100000:3.0:1789050251.406376:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704179584 00000100:00100000:3.0:1789050251.406389:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789050251.406396:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c02a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875954704179840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050251.406443:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c02a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875954704179840:12345-0@lo:400:kworker.0 Request processed in 47us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050251.406450:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789050251.406464:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789050251.406469:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875954704179584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050251.406489:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875954704179584:12345-0@lo:400:kworker.0 Request processed in 20us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050251.406494:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789050251.406781:0:19616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704179328 00000100:00100000:3.0:1789050251.406786:0:19616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704179328 00000100:00100000:3.0:1789050251.406809:0:19616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704179456 00000100:00100000:3.0:1789050251.406811:0:19616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704179456 00000100:00100000:3.0:1789050251.406821:0:19616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789050251.406828:0:19616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704179328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050251.406860:0:19616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704179328:12345-0@lo:400:kworker.0 Request processed in 33us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050251.406866:0:19616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789050251.406876:0:19616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789050251.406880:0:19616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3281:x1875954704179456:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789050251.406902:0:19616:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:3.0:1789050251.406926:0:19616:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9df728c939b7a4a6 00002000:00100000:3.0:1789050251.406939:0:19616:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff950737b78000 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789050251.406948:0:19616:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789050251.406951:0:19616:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:0.0:1789050251.407415:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c028700 x1875954704179584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050251.407430:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c028700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875954704179584:0@lo:400:kworker.0 00000100:00100000:0.0:1789050251.407446:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789050251.407453:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875954704179712:0@lo:400:kworker.0 00000100:00100000:0.0:1789050251.407481:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789050251.407509:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789050251.407513:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050251.407522:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704179712 00000100:00100000:0.0:1789050251.407526:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704179712 00000100:00100000:0.0:1789050251.407567:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789050251.407573:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875954704179712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789050251.407604:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875954704179712:12345-0@lo:400:kworker.0 Request processed in 31us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050251.407610:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789050251.407622:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050251.407639:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c02b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704179328:0@lo:400:kworker.0 00010000:00080000:0.0:1789050251.407660:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c02bb80 x1875954704179840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050251.407669:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c02bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875954704179840:0@lo:400:kworker.0 00010000:00080000:0.0:1789050251.407687:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c029f80 x1875954704179712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789050267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050251.407695:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1875954704179712:0@lo:400:kworker.0 00002000:00080000:3.0:1789050251.409020:0:19616:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789050251.409056:0:19616:0:(import.c:65:import_set_state_nolock()) ffff950737b7d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789050251.409121:0:19616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1875954704179456:12345-0@lo:8:kworker.0 Request processed in 2238us (2995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050251.409130:0:19616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789050251.411083:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704179200 00000100:00100000:3.0:1789050251.411095:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704179200 00000100:00100000:2.0:1789050251.415566:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789050251.415580:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:3282:x1875954704179200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050251.415664:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708782c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:3282:x1875954704179200:12345-0@lo:400:kworker.0 Request processed in 87us (9703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050251.415671:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:0.0:1789050251.415963:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95073c02b480 x1875954704179456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789050276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789050251.415980:0:3281:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789050251.415988:0:3281:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:0.0:1789050251.415993:0:3281:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789050251.415996:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9507039ef000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789050251.416012:0:3281:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789050251.416018:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c02b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3281:1875954704179456:0@lo:8:kworker.0 00000100:00100000:0.0:1789050251.416052:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c02aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7878f230-1e80-42fc-b48c-88e089c8a2b3:3282:1875954704179200:0@lo:400:kworker.0 00000004:00080000:2.0:1789050251.416475:0:18957:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x22:0x0] 00000100:00100000:2.0:1789050251.416496:0:18957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18957:1875954704180096:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789050251.416539:0:18957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050251.416568:0:18957:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704f3c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789050251.420658:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050251.420684:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704179968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050251.420752:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050251.420804:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704179968 00000100:00100000:0.0:1789050251.420811:0:19618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704179968 00000100:00100000:0.0:1789050251.420860:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789050251.420869:0:19618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1875954704179968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789050251.420903:0:19618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789050251.420947:0:19618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1875954704179968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050251.420962:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789050251.420982:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789050251.421011:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff950720827b80 x1875954704179968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789050267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789050251.421029:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704179968:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1789050251.421775:0:18956:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789050251.422235:0:18956:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 487410034071ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789050251.422271:0:19616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704180096 00000100:00100000:3.0:1789050251.422277:0:19616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704180096 00000100:00100000:3.0:1789050251.422313:0:19616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789050251.422321:0:19616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:18957:x1875954704180096:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789050251.430285:0:19616:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789050251.430296:0:19616:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1789050251.430301:0:19616:0:(ofd_dev.c:1497:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:35 to 0x280000400:65) 00002000:00010000:3.0:1789050251.455471:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050251.455483:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c339402/0x9df728c939b7a4ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.455498:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=487s v=(0 0) 00010000:00010000:3.0:1789050251.455503:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050251.455509:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c339402/0x9df728c939b7a4ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.455526:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c339402/0x9df728c939b7a4ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.455558:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c339402/0x9df728c939b7a4ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.455570:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c339402/0x9df728c939b7a4ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.455596:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789050251.455688:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050251.455696:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c339402/0x9df728c939b7a4ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.455720:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050251.455725:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c339402/0x9df728c939b7a4ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.455735:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c339402/0x9df728c939b7a4ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.455756:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c339402/0x9df728c939b7a4ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.455765:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c339402/0x9df728c939b7a4ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.455791:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050251.455794:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050251.455797:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050251.456049:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050251.456055:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a115795e/0x9df728c939b7a4b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.456063:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=487s v=(0 0) 00010000:00010000:3.0:1789050251.456066:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050251.456070:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a115795e/0x9df728c939b7a4b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.456079:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a115795e/0x9df728c939b7a4b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.456086:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a115795e/0x9df728c939b7a4b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.456092:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a115795e/0x9df728c939b7a4b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.456119:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789050251.456129:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050251.456133:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a115795e/0x9df728c939b7a4b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.456141:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331a00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050251.456144:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a115795e/0x9df728c939b7a4b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.456152:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a115795e/0x9df728c939b7a4b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.456163:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a115795e/0x9df728c939b7a4b4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.456170:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a115795e/0x9df728c939b7a4b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.456183:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050251.456184:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050251.456186:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050251.456610:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050251.456616:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de7cef5e/0x9df728c939b7a4bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.456624:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=487s v=(0 0) 00010000:00010000:3.0:1789050251.456632:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050251.456636:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de7cef5e/0x9df728c939b7a4bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.456644:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de7cef5e/0x9df728c939b7a4bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.456652:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de7cef5e/0x9df728c939b7a4bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.456658:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de7cef5e/0x9df728c939b7a4bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.456674:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789050251.456684:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050251.456688:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de7cef5e/0x9df728c939b7a4bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.456695:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050251.456698:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de7cef5e/0x9df728c939b7a4bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.456706:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de7cef5e/0x9df728c939b7a4bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.456715:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de7cef5e/0x9df728c939b7a4bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.456734:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de7cef5e/0x9df728c939b7a4bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.456748:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050251.456750:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050251.456751:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050251.463123:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050251.463138:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a1ff10e/0x9df728c939b7a4c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.463156:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=487s v=(0 0) 00010000:00010000:3.0:1789050251.463161:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050251.463168:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a1ff10e/0x9df728c939b7a4c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.463184:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a1ff10e/0x9df728c939b7a4c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.463194:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a1ff10e/0x9df728c939b7a4c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.463228:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a1ff10e/0x9df728c939b7a4c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.463246:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789050251.463259:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050251.463272:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a1ff10e/0x9df728c939b7a4c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.463281:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050251.463285:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a1ff10e/0x9df728c939b7a4c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.463295:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a1ff10e/0x9df728c939b7a4c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.463311:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a1ff10e/0x9df728c939b7a4c2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.463319:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a1ff10e/0x9df728c939b7a4c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.463337:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050251.463339:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050251.463341:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050251.463867:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050251.463874:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f10cdeb9/0x9df728c939b7a4c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.465679:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=487s v=(0 0) 00010000:00010000:3.0:1789050251.465685:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050251.465693:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f10cdeb9/0x9df728c939b7a4c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.465725:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f10cdeb9/0x9df728c939b7a4c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.465736:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f10cdeb9/0x9df728c939b7a4c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.465745:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f10cdeb9/0x9df728c939b7a4c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.465807:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789050251.466476:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050251.466484:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b7a4d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.466494:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=487s v=(0 0) 00010000:00010000:3.0:1789050251.466499:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050251.466503:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b7a4d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.466513:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b7a4d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.466522:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b7a4d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.466539:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b7a4d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050251.467559:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050251.467571:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f10cdeb9/0x9df728c939b7a4c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050251.467583:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050251.467588:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f10cdeb9/0x9df728c939b7a4c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050251.467598:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f10cdeb9/0x9df728c939b7a4c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050251.467621:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f10cdeb9/0x9df728c939b7a4c9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050251.467628:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f10cdeb9/0x9df728c939b7a4c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050251.467649:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050251.467654:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b7a4d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050251.467672:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050251.467675:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b7a4d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050251.467682:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b7a4d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050251.467693:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b7a4d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050251.467702:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050251.467703:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050251.467706:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050251.478079:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789050251.478094:0:19616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5cbdbba/0x9df728c939b7a4d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.478153:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050251.478789:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050251.478798:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ee41601/0x9df728c939b7a4d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.478812:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=487s v=(0 0) 00010000:00010000:3.0:1789050251.478817:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050251.478823:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ee41601/0x9df728c939b7a4d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.478836:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ee41601/0x9df728c939b7a4d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.478845:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ee41601/0x9df728c939b7a4d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.478854:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ee41601/0x9df728c939b7a4d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.478892:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789050251.479346:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050251.479353:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de7cef5e/0x9df728c939b7a4de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.479362:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=487s v=(0 0) 00010000:00010000:3.0:1789050251.479365:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050251.479369:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de7cef5e/0x9df728c939b7a4de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.479377:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de7cef5e/0x9df728c939b7a4de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.479385:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de7cef5e/0x9df728c939b7a4de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.479392:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de7cef5e/0x9df728c939b7a4de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.479406:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789050251.479415:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789050251.479420:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ee41601/0x9df728c939b7a4d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.479427:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330e00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050251.479437:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ee41601/0x9df728c939b7a4d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.479446:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ee41601/0x9df728c939b7a4d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.479463:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ee41601/0x9df728c939b7a4d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.479471:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ee41601/0x9df728c939b7a4d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.479491:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050251.479495:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de7cef5e/0x9df728c939b7a4de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.479502:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050251.479506:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de7cef5e/0x9df728c939b7a4de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.479515:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de7cef5e/0x9df728c939b7a4de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.479526:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de7cef5e/0x9df728c939b7a4de lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.479533:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de7cef5e/0x9df728c939b7a4de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.479566:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050251.479567:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050251.479569:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050251.479812:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050251.480090:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050251.480096:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a115795e/0x9df728c939b7a4e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.480105:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=487s v=(0 0) 00010000:00010000:3.0:1789050251.480109:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050251.480113:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a115795e/0x9df728c939b7a4e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.480123:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a115795e/0x9df728c939b7a4e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.480131:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a115795e/0x9df728c939b7a4e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.480137:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a115795e/0x9df728c939b7a4e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.480160:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050251.480187:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050251.480195:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a115795e/0x9df728c939b7a4e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050251.480226:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331a00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050251.480230:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a115795e/0x9df728c939b7a4e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050251.480239:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a115795e/0x9df728c939b7a4e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050251.480253:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a115795e/0x9df728c939b7a4e5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050251.480267:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a115795e/0x9df728c939b7a4e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050251.480285:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050251.480287:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050251.480289:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789050251.480598:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789050251.480604:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001da5cdfc/0x9df728c939b7a4ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.480623:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=487s v=(0 0) 00010000:00010000:3.0:1789050251.480626:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050251.480630:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001da5cdfc/0x9df728c939b7a4ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.480640:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001da5cdfc/0x9df728c939b7a4ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.480648:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001da5cdfc/0x9df728c939b7a4ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.480655:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001da5cdfc/0x9df728c939b7a4ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.480677:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789050251.480742:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050251.480748:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001da5cdfc/0x9df728c939b7a4ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050251.480757:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050251.480761:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001da5cdfc/0x9df728c939b7a4ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050251.480768:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001da5cdfc/0x9df728c939b7a4ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050251.480781:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001da5cdfc/0x9df728c939b7a4ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050251.480789:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001da5cdfc/0x9df728c939b7a4ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050251.480806:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050251.480808:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050251.480810:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789050251.500099:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1789050251.500622:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050251.500633:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5e561ab/0x9df728c939b7a4f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.500650:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=487s v=(0 0) 00010000:00010000:2.0:1789050251.500654:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050251.500661:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5e561ab/0x9df728c939b7a4f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.500689:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5e561ab/0x9df728c939b7a4f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.500700:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5e561ab/0x9df728c939b7a4f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.500708:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5e561ab/0x9df728c939b7a4f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.500737:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789050251.500993:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050251.501000:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5e561ab/0x9df728c939b7a4f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.501009:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050251.501014:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5e561ab/0x9df728c939b7a4f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.501023:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5e561ab/0x9df728c939b7a4f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.501048:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5e561ab/0x9df728c939b7a4f3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.501055:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5e561ab/0x9df728c939b7a4f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050251.502169:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050251.502178:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b7a4fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.502226:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=487s v=(0 0) 00010000:00010000:2.0:1789050251.502241:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050251.502246:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b7a4fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.502260:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b7a4fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.502269:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b7a4fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.502299:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b7a4fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.502313:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789050251.502774:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050251.502780:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007704dfad/0x9df728c939b7a501 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.502789:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=487s v=(0 0) 00010000:00010000:2.0:1789050251.502793:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050251.502797:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007704dfad/0x9df728c939b7a501 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.502806:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007704dfad/0x9df728c939b7a501 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.502813:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007704dfad/0x9df728c939b7a501 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.502821:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007704dfad/0x9df728c939b7a501 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.502830:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789050251.503224:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050251.503231:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b7a508 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.503245:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=487s v=(0 0) 00010000:00010000:2.0:1789050251.503248:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050251.503252:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b7a508 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.503261:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b7a508 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.503269:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b7a508 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.503276:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b7a508 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.503285:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1789050251.503686:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050251.503692:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0d58e18/0x9df728c939b7a50f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.503702:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=487s v=(0 0) 00010000:00010000:2.0:1789050251.503705:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050251.503709:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0d58e18/0x9df728c939b7a50f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.503719:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0d58e18/0x9df728c939b7a50f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.503738:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0d58e18/0x9df728c939b7a50f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.503745:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0d58e18/0x9df728c939b7a50f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.503753:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1789050251.504354:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789050251.506513:0:20603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789050251.506528:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b7a4fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.506552:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050251.506558:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b7a4fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.506570:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b7a4fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.506744:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b7a4fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.506753:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e25c5f1c/0x9df728c939b7a4fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789050251.507164:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050251.507173:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b7a516 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.507196:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=487s v=(0 0) 00010000:00010000:2.0:1789050251.507216:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050251.507223:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b7a516 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.507245:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b7a516 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.507255:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b7a516 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.507263:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b7a516 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.507300:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1789050251.507765:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050251.507772:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ea2a9c8/0x9df728c939b7a51d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.507781:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=487s v=(0 0) 00010000:00010000:2.0:1789050251.507785:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050251.507788:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ea2a9c8/0x9df728c939b7a51d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.507798:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ea2a9c8/0x9df728c939b7a51d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.507806:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ea2a9c8/0x9df728c939b7a51d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.507813:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ea2a9c8/0x9df728c939b7a51d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.507822:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1789050251.508243:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050251.508250:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6abc74b/0x9df728c939b7a524 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.508259:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=487s v=(0 0) 00010000:00010000:2.0:1789050251.508267:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050251.508272:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6abc74b/0x9df728c939b7a524 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.508281:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6abc74b/0x9df728c939b7a524 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.508290:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6abc74b/0x9df728c939b7a524 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.508297:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6abc74b/0x9df728c939b7a524 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.508305:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1789050251.508639:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050251.508645:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b7a52b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.508653:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=487s v=(0 0) 00010000:00010000:2.0:1789050251.508655:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050251.508659:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b7a52b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.508669:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b7a52b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.508677:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b7a52b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.508689:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b7a52b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.508697:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1789050251.509027:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050251.509032:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b7a532 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.509040:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=487s v=(0 0) 00010000:00010000:2.0:1789050251.509043:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050251.509047:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b7a532 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.509056:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b7a532 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.509064:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b7a532 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.509072:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b7a532 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.509079:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1789050251.509467:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789050251.509473:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000015ed7c2/0x9df728c939b7a539 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.509487:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=487s v=(0 0) 00010000:00010000:2.0:1789050251.509489:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050251.509493:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000015ed7c2/0x9df728c939b7a539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.509503:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000015ed7c2/0x9df728c939b7a539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.509512:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000015ed7c2/0x9df728c939b7a539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.509519:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000015ed7c2/0x9df728c939b7a539 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050251.509527:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:3.0:1789050251.510456:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1789050251.510456:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1789050251.510469:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0d58e18/0x9df728c939b7a50f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.510469:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b7a508 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510496:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050251.510496:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050251.510507:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0d58e18/0x9df728c939b7a50f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.510507:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b7a508 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510534:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0d58e18/0x9df728c939b7a50f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510564:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0d58e18/0x9df728c939b7a50f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510571:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0d58e18/0x9df728c939b7a50f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510589:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1789050251.510593:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b7a516 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510617:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050251.510621:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b7a516 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510630:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b7a516 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510642:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b7a516 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510649:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b312a5e3/0x9df728c939b7a516 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510667:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789050251.510671:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ea2a9c8/0x9df728c939b7a51d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510677:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50a00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050251.510681:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ea2a9c8/0x9df728c939b7a51d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510688:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ea2a9c8/0x9df728c939b7a51d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510697:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ea2a9c8/0x9df728c939b7a51d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510711:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ea2a9c8/0x9df728c939b7a51d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510726:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789050251.510729:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6abc74b/0x9df728c939b7a524 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510735:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50800 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050251.510738:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6abc74b/0x9df728c939b7a524 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510745:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6abc74b/0x9df728c939b7a524 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510755:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6abc74b/0x9df728c939b7a524 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510762:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6abc74b/0x9df728c939b7a524 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510788:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789050251.510791:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b7a52b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510797:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050251.510806:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b7a52b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510813:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b7a52b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510823:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b7a52b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510830:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de62d24d/0x9df728c939b7a52b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510845:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789050251.510849:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b7a532 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510854:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701489200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050251.510858:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b7a532 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510865:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b7a532 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510874:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b7a532 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510880:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c318e94/0x9df728c939b7a532 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510906:0:18921:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789050251.510910:0:18921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000015ed7c2/0x9df728c939b7a539 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510916:0:18921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050251.510918:0:18921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000015ed7c2/0x9df728c939b7a539 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510925:0:18921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000015ed7c2/0x9df728c939b7a539 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.510932:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b7a508 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.510936:0:18921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000015ed7c2/0x9df728c939b7a539 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.510960:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b7a508 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.510969:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8061bf0/0x9df728c939b7a508 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.510985:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.510987:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.510995:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050251.511221:0:18921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000015ed7c2/0x9df728c939b7a539 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050251.511237:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050251.511239:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050251.511240:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.511268:0:20607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.511277:0:20603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007704dfad/0x9df728c939b7a501 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.511286:0:20603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050251.511290:0:20603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007704dfad/0x9df728c939b7a501 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.511298:0:20603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007704dfad/0x9df728c939b7a501 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.511309:0:20603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007704dfad/0x9df728c939b7a501 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.511315:0:20603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007704dfad/0x9df728c939b7a501 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.511327:0:20603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.511329:0:20603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.511331:0:20603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.511335:0:20607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.511336:0:20607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789050251.517883:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789050251.517894:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083df790a/0x9df728c939b7a540 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.517911:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789050251.517923:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050251.517930:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083df790a/0x9df728c939b7a540 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.517944:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083df790a/0x9df728c939b7a540 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.517954:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083df790a/0x9df728c939b7a540 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.517962:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083df790a/0x9df728c939b7a540 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.517982:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789050251.517994:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050251.518000:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083df790a/0x9df728c939b7a540 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.518007:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bc0f600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050251.518011:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083df790a/0x9df728c939b7a540 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.518020:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083df790a/0x9df728c939b7a540 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.518036:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083df790a/0x9df728c939b7a540 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.518055:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083df790a/0x9df728c939b7a540 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.518087:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.518089:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.518091:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789050251.518775:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789050251.518783:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e4ce6e0/0x9df728c939b7a547 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.518794:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789050251.518798:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050251.518803:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e4ce6e0/0x9df728c939b7a547 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.518813:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e4ce6e0/0x9df728c939b7a547 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.518822:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e4ce6e0/0x9df728c939b7a547 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.518830:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e4ce6e0/0x9df728c939b7a547 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.518848:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789050251.519695:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789050251.519708:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc5edf95/0x9df728c939b7a54e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.519719:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789050251.519723:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050251.519728:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc5edf95/0x9df728c939b7a54e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.519738:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc5edf95/0x9df728c939b7a54e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.519747:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc5edf95/0x9df728c939b7a54e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.519755:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc5edf95/0x9df728c939b7a54e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.519773:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789050251.519789:0:20603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789050251.519794:0:20603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e4ce6e0/0x9df728c939b7a547 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.519801:0:20603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bc0ec00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050251.519806:0:20603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e4ce6e0/0x9df728c939b7a547 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.519814:0:20603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e4ce6e0/0x9df728c939b7a547 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.519836:0:20603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e4ce6e0/0x9df728c939b7a547 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.519844:0:20603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e4ce6e0/0x9df728c939b7a547 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.519863:0:20603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050251.519866:0:20603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc5edf95/0x9df728c939b7a54e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.519873:0:20603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95073bc0e800 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050251.519876:0:20603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc5edf95/0x9df728c939b7a54e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.519884:0:20603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc5edf95/0x9df728c939b7a54e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.519894:0:20603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc5edf95/0x9df728c939b7a54e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.519901:0:20603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc5edf95/0x9df728c939b7a54e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.519911:0:20603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.519913:0:20603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.519920:0:20603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789050251.520606:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789050251.520613:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001458274a/0x9df728c939b7a555 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.520623:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789050251.520627:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050251.520631:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001458274a/0x9df728c939b7a555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.520642:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001458274a/0x9df728c939b7a555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.520651:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001458274a/0x9df728c939b7a555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.520658:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001458274a/0x9df728c939b7a555 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.520673:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789050251.520684:0:20607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050251.520688:0:20607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001458274a/0x9df728c939b7a555 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.520695:0:20607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605cf8000 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050251.520698:0:20607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001458274a/0x9df728c939b7a555 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.520716:0:20607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001458274a/0x9df728c939b7a555 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.520728:0:20607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001458274a/0x9df728c939b7a555 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.520735:0:20607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001458274a/0x9df728c939b7a555 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.520750:0:20607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.520752:0:20607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.520754:0:20607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789050251.521175:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789050251.521182:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f0b4059/0x9df728c939b7a55c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.521191:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789050251.521194:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050251.521222:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f0b4059/0x9df728c939b7a55c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.521241:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f0b4059/0x9df728c939b7a55c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.521249:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f0b4059/0x9df728c939b7a55c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.521262:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f0b4059/0x9df728c939b7a55c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.521626:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789050251.521641:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050251.521645:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f0b4059/0x9df728c939b7a55c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.521653:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605cf8400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050251.521657:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f0b4059/0x9df728c939b7a55c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.521664:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f0b4059/0x9df728c939b7a55c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.521676:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f0b4059/0x9df728c939b7a55c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.521684:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f0b4059/0x9df728c939b7a55c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.521702:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.521703:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.521705:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050251.522368:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789050251.522570:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789050251.522585:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001335bc6e/0x9df728c939b7a563 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.522597:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789050251.522601:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050251.522606:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001335bc6e/0x9df728c939b7a563 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.522617:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001335bc6e/0x9df728c939b7a563 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.522626:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001335bc6e/0x9df728c939b7a563 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.522635:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001335bc6e/0x9df728c939b7a563 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.522649:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789050251.522658:0:20603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050251.522662:0:20603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001335bc6e/0x9df728c939b7a563 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.522670:0:20603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605cf8600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050251.522674:0:20603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001335bc6e/0x9df728c939b7a563 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.522681:0:20603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001335bc6e/0x9df728c939b7a563 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.522698:0:20603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001335bc6e/0x9df728c939b7a563 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.522706:0:20603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001335bc6e/0x9df728c939b7a563 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.522721:0:20603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.522722:0:20603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.522724:0:20603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789050251.523163:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789050251.523169:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b092/0x9df728c939b7a56a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.523179:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789050251.523183:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050251.523224:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b092/0x9df728c939b7a56a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.523241:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b092/0x9df728c939b7a56a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.523250:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b092/0x9df728c939b7a56a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.523257:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b092/0x9df728c939b7a56a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.523288:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789050251.523298:0:20607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050251.523302:0:20607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b092/0x9df728c939b7a56a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.523309:0:20607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605cf9e00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050251.523313:0:20607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b092/0x9df728c939b7a56a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.523321:0:20607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b092/0x9df728c939b7a56a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.523332:0:20607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b092/0x9df728c939b7a56a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.523340:0:20607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9f6b092/0x9df728c939b7a56a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.523354:0:20607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.523355:0:20607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.523357:0:20607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789050251.523736:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789050251.523742:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000499298e0/0x9df728c939b7a571 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.523752:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789050251.523762:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050251.523766:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000499298e0/0x9df728c939b7a571 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.523776:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000499298e0/0x9df728c939b7a571 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.523783:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000499298e0/0x9df728c939b7a571 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.523790:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000499298e0/0x9df728c939b7a571 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.523806:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789050251.523815:0:18920:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050251.523820:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000499298e0/0x9df728c939b7a571 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.523827:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605cf9200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050251.523831:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000499298e0/0x9df728c939b7a571 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.523839:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000499298e0/0x9df728c939b7a571 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.523848:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000499298e0/0x9df728c939b7a571 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.523866:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000499298e0/0x9df728c939b7a571 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.523879:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.523881:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.523882:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789050251.524269:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789050251.524275:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ded26da6/0x9df728c939b7a578 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.524283:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789050251.524287:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050251.524290:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ded26da6/0x9df728c939b7a578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.524299:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ded26da6/0x9df728c939b7a578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.524307:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ded26da6/0x9df728c939b7a578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.524314:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ded26da6/0x9df728c939b7a578 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.524333:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789050251.524737:0:19616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789050251.524748:0:19616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adf2f237/0x9df728c939b7a57f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.524756:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1789050251.524759:0:19616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050251.524763:0:19616:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adf2f237/0x9df728c939b7a57f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.524771:0:19616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adf2f237/0x9df728c939b7a57f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.524779:0:19616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adf2f237/0x9df728c939b7a57f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.524785:0:19616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000adf2f237/0x9df728c939b7a57f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.524801:0:19616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789050251.524815:0:20603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789050251.524819:0:20603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ded26da6/0x9df728c939b7a578 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.524827:0:20603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605cf9600 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050251.524830:0:20603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ded26da6/0x9df728c939b7a578 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.524837:0:20603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ded26da6/0x9df728c939b7a578 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.524854:0:20603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ded26da6/0x9df728c939b7a578 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.524862:0:20603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ded26da6/0x9df728c939b7a578 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.524879:0:20603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789050251.524881:0:20603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000adf2f237/0x9df728c939b7a57f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.524888:0:20603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605cf9000 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050251.524891:0:20603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000adf2f237/0x9df728c939b7a57f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.524898:0:20603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000adf2f237/0x9df728c939b7a57f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.524908:0:20603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000adf2f237/0x9df728c939b7a57f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.524915:0:20603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adf2f237/0x9df728c939b7a57f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050251.524927:0:20603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.524929:0:20603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050251.524936:0:20603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789050251.525117:0:19616:0:(ofd_dev.c:1524:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:34 00000100:00100000:1.0:1789050251.525237:0:19616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:18957:x1875954704180096:12345-0@lo:5:osp-pre-1-0.0 Request processed in 102914us (108695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050251.525249:0:19616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789050251.525306:0:18957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18957:1875954704180096:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789050251.525321:0:18957:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x22:0x0] 00000100:00100000:1.0:1789050251.525364:0:18957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c517100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18957:1875954704180224:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789050251.525395:0:18957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050251.525429:0:18957:0:(client.c:2716:ptlrpc_set_wait()) set ffff95070635d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789050251.525444:0:19616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704180224 00000100:00100000:1.0:1789050251.525450:0:19616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704180224 00000100:00100000:1.0:1789050251.525485:0:19616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789050251.525492:0:19616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:18957:x1875954704180224:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789050251.525526:0:19616:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00010000:00010000:2.0:1789050251.526525:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050251.535503:0:19616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:18957:x1875954704180224:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10005us (10101us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1789050251.535514:0:19616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789050251.535577:0:18957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c517100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18957:1875954704180224:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789050251.535590:0:18957:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00010000:00010000:2.0:1789050251.852463:0:20607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050252.875494:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789050253.077604:0:20692:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg601-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789050253.906784:0:20603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050254.475429:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789050254.477978:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704180352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789050254.478054:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050254.478500:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704180352 00000100:00100000:0.0:1789050254.478508:0:19618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704180352 00000100:00100000:0.0:1789050254.478638:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789050254.478648:0:19618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704180352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789050254.478683:0:19618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789050254.478743:0:19618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704180352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050254.478751:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789050254.478861:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704180352:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789050254.479061:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789050254.924667:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789050255.376933:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050255.378824:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691607936 00000100:00100000:0.0:1789050255.378837:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691607936 00000100:00100000:0.0:1789050255.378889:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 75 00000100:00100000:0.0:1789050255.378897:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2346:x1875954691607936:12345-192.168.206.1@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789050255.378924:0:18927:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from b83cae77-0a6f-4d94-80d9-6507de3f20fd@192.168.206.1@tcp t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:0.0:1789050255.378951:0:18927:0:(genops.c:1384:class_connect()) connect: client b83cae77-0a6f-4d94-80d9-6507de3f20fd, cookie 0x9df728c939b7a586 00000100:00080000:0.0:1789050255.379090:0:18927:0:(import.c:65:import_set_state_nolock()) ffff9506074bc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789050255.379169:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+5:2346:x1875954691607936:12345-192.168.206.1@tcp:250:mount.lustre.0 Request processed in 270us (2243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050255.379177:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 75 00000100:00100000:1.0:1789050255.394032:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050255.394122:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691608064 00000100:00100000:2.0:1789050255.394130:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691608064 00000100:00100000:2.0:1789050255.394188:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 76 00000100:00100000:2.0:1789050255.394843:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+5:16750:x1875954691608064:12345-192.168.206.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789050255.394874:0:18926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050255.397931:0:18926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703331600/0x9df728c939b7a58d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fd6c expref: -99 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050255.397974:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703331600/0x9df728c939b7a58d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd6c expref: 6 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050255.398005:0:18926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703331600/0x9df728c939b7a58d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd6c expref: 6 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050255.398014:0:18926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331600, rc 0) 00000100:00100000:3.0:1789050255.398090:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708783450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+6:16750:x1875954691608064:12345-192.168.206.1@tcp:101:mount.lustre.0 Request processed in 3892us (4065us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050255.398099:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 76 00000100:00100000:1.0:1789050255.407905:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050255.408050:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691608192 00000100:00100000:2.0:1789050255.408060:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691608192 00000100:00100000:2.0:1789050255.408123:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 77 00000100:00100000:2.0:1789050255.408133:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+6:16750:x1875954691608192:12345-192.168.206.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789050255.408875:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+6:16750:x1875954691608192:12345-192.168.206.1@tcp:501:mount.lustre.0 Request processed in 740us (976us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789050255.408884:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 77 00000100:00100000:1.0:1789050255.411891:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050255.412081:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691608320 00000100:00100000:3.0:1789050255.412091:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691608320 00000100:00100000:3.0:1789050255.412294:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 78 00000100:00100000:3.0:1789050255.412304:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+6:16750:x1875954691608320:12345-192.168.206.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789050255.412319:0:18926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050255.412334:0:18926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703330e00/0x9df728c939b7a594 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fd73 expref: -99 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050255.412359:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703330e00/0x9df728c939b7a594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd73 expref: 7 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050255.412370:0:18926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703330e00/0x9df728c939b7a594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd73 expref: 7 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050255.412379:0:18926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330e00, rc 0) 00000100:00100000:3.0:1789050255.412431:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708780050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+7:16750:x1875954691608320:12345-192.168.206.1@tcp:101:mount.lustre.0 Request processed in 129us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050255.412439:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 78 00000100:00100000:1.0:1789050255.422330:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050255.422517:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691608448 00000100:00100000:2.0:1789050255.422537:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691608448 00000100:00100000:2.0:1789050255.422596:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 79 00000100:00100000:2.0:1789050255.422607:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+7:16750:x1875954691608448:12345-192.168.206.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789050255.423623:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708780450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+8:16750:x1875954691608448:12345-192.168.206.1@tcp:501:mount.lustre.0 Request processed in 1013us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050255.423633:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 79 00000100:00100000:2.0:1789050255.426752:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050255.431725:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691608576 00000100:00100000:0.0:1789050255.431742:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691608576 00000100:00100000:2.0:1789050255.436736:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 80 00000100:00100000:2.0:1789050255.436751:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+8:16750:x1875954691608576:12345-192.168.206.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789050255.437158:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+8:16750:x1875954691608576:12345-192.168.206.1@tcp:503:mount.lustre.0 Request processed in 409us (10412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050255.437167:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 80 00000100:00100000:3.0:1789050255.442354:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050255.444782:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691608704 00000100:00100000:0.0:1789050255.444795:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691608704 00000100:00100000:0.0:1789050255.444850:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 81 00000100:00100000:0.0:1789050255.444861:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+8:16768:x1875954691608704:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789050255.445736:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+8:16768:x1875954691608704:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 863us (3376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050255.445746:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 81 00000100:00100000:1.0:1789050255.470066:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050255.470185:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691608832 00000100:00100000:0.0:1789050255.470233:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691608832 00000100:00100000:0.0:1789050255.470306:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 82 00000100:00100000:0.0:1789050255.470317:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950708780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+8:16768:x1875954691608832:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789050255.470830:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950708780c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+8:16768:x1875954691608832:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 512us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050255.470838:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 82 00000100:00100000:3.0:1789050255.481682:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050255.482018:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691608960 00000100:00100000:1.0:1789050255.482027:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691608960 00000100:00100000:1.0:1789050255.482086:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 83 00000100:00100000:1.0:1789050255.482104:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+8:16750:x1875954691608960:12345-192.168.206.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789050255.482119:0:18925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050255.482136:0:18925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950605cf9a00/0x9df728c939b7a59b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fd9d expref: -99 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050255.482162:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950605cf9a00/0x9df728c939b7a59b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd9d expref: 9 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050255.482174:0:18925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950605cf9a00/0x9df728c939b7a59b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fd9d expref: 9 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050255.482182:0:18925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605cf9a00, rc 0) 00000100:00100000:1.0:1789050255.482275:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+9:16750:x1875954691608960:12345-192.168.206.1@tcp:101:mount.lustre.0 Request processed in 173us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050255.482282:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 83 00000100:00100000:3.0:1789050255.492426:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050255.492591:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691609088 00000100:00100000:2.0:1789050255.492611:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691609088 00000100:00100000:2.0:1789050255.492667:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 84 00000100:00100000:2.0:1789050255.492678:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+9:16750:x1875954691609088:12345-192.168.206.1@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789050255.492711:0:18926:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789050255.492727:0:18926:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789050255.492731:0:18926:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789050255.492734:0:18926:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789050255.492737:0:18926:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:2.0:1789050255.499332:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+9:16750:x1875954691609088:12345-192.168.206.1@tcp:256:mount.lustre.0 Request processed in 6635us (6894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050255.499349:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 84 00000100:00100000:3.0:1789050255.506865:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050255.507106:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691609216 00000100:00100000:0.0:1789050255.507115:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691609216 00000100:00100000:0.0:1789050255.507172:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 85 00000100:00100000:0.0:1789050255.507182:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+9:16750:x1875954691609216:12345-192.168.206.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789050255.507234:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050255.507252:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950605f06e00/0x9df728c939b7a5a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fda4 expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050255.507279:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950605f06e00/0x9df728c939b7a5a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fda4 expref: 10 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050255.507289:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950605f06e00/0x9df728c939b7a5a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fda4 expref: 10 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050255.507297:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06e00, rc 0) 00000100:00100000:0.0:1789050255.508949:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+10:16750:x1875954691609216:12345-192.168.206.1@tcp:101:mount.lustre.0 Request processed in 1760us (2086us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050255.508971:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 85 00000100:00100000:3.0:1789050255.514452:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050255.514544:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691609344 00000100:00100000:2.0:1789050255.514561:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691609344 00000100:00100000:2.0:1789050255.514625:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 86 00000100:00100000:2.0:1789050255.514635:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+10:16750:x1875954691609344:12345-192.168.206.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789050255.515594:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+10:16750:x1875954691609344:12345-192.168.206.1@tcp:501:mount.lustre.0 Request processed in 955us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050255.515695:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 86 00000100:00100000:1.0:1789050255.521575:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050255.521785:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691609472 00000100:00100000:0.0:1789050255.521800:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691609472 00000100:00100000:0.0:1789050255.521853:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 87 00000100:00100000:0.0:1789050255.521863:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+10:16750:x1875954691609472:12345-192.168.206.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789050255.522172:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+10:16750:x1875954691609472:12345-192.168.206.1@tcp:503:mount.lustre.0 Request processed in 310us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050255.522181:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 87 00000100:00100000:0.0:1789050255.528485:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050255.528996:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691609600 00000100:00100000:2.0:1789050255.529006:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691609600 00000100:00100000:2.0:1789050255.529061:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 88 00000100:00100000:2.0:1789050255.529071:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+10:16773:x1875954691609600:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789050255.529458:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+10:16773:x1875954691609600:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 387us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050255.529466:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 88 00000100:00100000:1.0:1789050255.540428:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050255.540536:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691609728 00000100:00100000:0.0:1789050255.540546:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691609728 00000100:00100000:0.0:1789050255.540959:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 89 00000100:00100000:0.0:1789050255.540971:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+10:16773:x1875954691609728:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789050255.541313:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704166c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+10:16773:x1875954691609728:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 344us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050255.541322:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 89 00000100:00100000:2.0:1789050255.554442:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050255.554580:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691609856 00000100:00100000:3.0:1789050255.554589:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691609856 00000100:00100000:3.0:1789050255.554638:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:3.0:1789050255.554645:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2346:x1875954691609856:12345-192.168.206.1@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789050255.554672:0:18934:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 0fd1a549-5106-461c-9c28-9bc689851eed@192.168.206.1@tcp t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:3.0:1789050255.554720:0:18934:0:(genops.c:1384:class_connect()) connect: client 0fd1a549-5106-461c-9c28-9bc689851eed, cookie 0x9df728c939b7a5a9 00000004:00100000:3.0:1789050255.554746:0:18934:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789050255.554752:0:18934:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:3.0:1789050255.613570:0:18934:0:(import.c:65:import_set_state_nolock()) ffff950737b7c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789050255.613673:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+6:2346:x1875954691609856:12345-192.168.206.1@tcp:38:mount.lustre.0 Request processed in 59025us (59237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050255.613683:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:3.0:1789050255.619167:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050255.619390:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691609984 00000100:00100000:0.0:1789050255.619400:0:18932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691609984 00000100:00100000:0.0:1789050255.619468:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00100000:0.0:1789050255.619479:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd1a549-5106-461c-9c28-9bc689851eed+6:0:x1875954691609984:12345-192.168.206.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789050255.619518:0:18932:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789050255.619616:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd1a549-5106-461c-9c28-9bc689851eed+6:0:x1875954691609984:12345-192.168.206.1@tcp:41:mount.lustre.0 Request processed in 139us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050255.619623:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00080000:2.0:1789050255.619714:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050255.624508:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050255.624597:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691610112 00000100:00100000:3.0:1789050255.624607:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691610112 00000100:00100000:3.0:1789050255.625029:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:3.0:1789050255.625040:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+6:16750:x1875954691610112:12345-192.168.206.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789050255.625069:0:18934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789050255.625144:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+6:16750:x1875954691610112:12345-192.168.206.1@tcp:41:mount.lustre.0 Request processed in 106us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050255.625151:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:2.0:1789050255.632904:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050255.633005:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691610240 00000100:00100000:3.0:1789050255.633027:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691610240 00000100:00100000:3.0:1789050255.633277:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:3.0:1789050255.633289:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd1a549-5106-461c-9c28-9bc689851eed+6:16750:x1875954691610240:12345-192.168.206.1@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789050255.633422:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd1a549-5106-461c-9c28-9bc689851eed+6:16750:x1875954691610240:12345-192.168.206.1@tcp:40:mount.lustre.0 Request processed in 134us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050255.633429:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:1.0:1789050255.638387:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050255.638489:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050255.638533:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050255.638574:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050255.638638:0:18935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691610752 00000100:00100000:3.0:1789050255.638647:0:18935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691610752 00000100:00100000:3.0:1789050255.638696:0:18935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:3.0:1789050255.638718:0:18935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0fd1a549-5106-461c-9c28-9bc689851eed+6:16750:x1875954691610752:12345-192.168.206.1@tcp:33:mount.lustre.0 00000100:00100000:0.0:1789050255.639387:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691610496 00000100:00100000:0.0:1789050255.639393:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691610496 00000100:00100000:0.0:1789050255.639435:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 90 00000100:00100000:0.0:1789050255.639443:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+10:2349:x1875954691610496:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789050255.639502:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+10:2349:x1875954691610496:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 59us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050255.639509:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 90 00000004:00080000:0.0:1789050255.640099:0:18935:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1310us 00000100:00100000:2.0:1789050255.656906:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691610368 00000100:00100000:2.0:1789050255.656935:0:19617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691610368 00000100:00100000:2.0:1789050255.656995:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691610624 00000100:00100000:2.0:1789050255.656998:0:19617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691610624 00000100:00100000:2.0:1789050255.657015:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:2.0:1789050255.657023:0:19617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875954691610368:12345-192.168.206.1@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789050255.657054:0:19617:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0fd1a549-5106-461c-9c28-9bc689851eed@192.168.206.1@tcp t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:2.0:1789050255.657082:0:19617:0:(genops.c:1384:class_connect()) connect: client 0fd1a549-5106-461c-9c28-9bc689851eed, cookie 0x9df728c939b7a5b0 00002000:00100000:2.0:1789050255.657102:0:19617:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0fd1a549-5106-461c-9c28-9bc689851eed/ffff950736015800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789050255.657113:0:19617:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789050255.657879:0:19617:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789050255.657913:0:19617:0:(import.c:65:import_set_state_nolock()) ffff950736013800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789050255.658030:0:19617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0fd1a549-5106-461c-9c28-9bc689851eed+6:2346:x1875954691610368:12345-192.168.206.1@tcp:8:mount.lustre.0 Request processed in 1006us (19663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050255.658040:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:2.0:1789050255.658061:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:2.0:1789050255.658066:0:19617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875954691610624:12345-192.168.206.1@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789050255.658085:0:19617:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0fd1a549-5106-461c-9c28-9bc689851eed@192.168.206.1@tcp t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:2.0:1789050255.658121:0:19617:0:(genops.c:1384:class_connect()) connect: client 0fd1a549-5106-461c-9c28-9bc689851eed, cookie 0x9df728c939b7a5b7 00002000:00100000:2.0:1789050255.658130:0:19617:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0fd1a549-5106-461c-9c28-9bc689851eed/ffff950736010800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789050255.658146:0:19617:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789050255.658291:0:19617:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789050255.658307:0:19617:0:(import.c:65:import_set_state_nolock()) ffff950736013000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789050255.658331:0:19617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0fd1a549-5106-461c-9c28-9bc689851eed+6:2346:x1875954691610624:12345-192.168.206.1@tcp:8:mount.lustre.0 Request processed in 263us (19757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050255.658338:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 9 00000004:00200000:2.0:1789050255.666832:0:18935:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789050255.666940:0:18935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0fd1a549-5106-461c-9c28-9bc689851eed+6:16750:x1875954691610752:12345-192.168.206.1@tcp:33:mount.lustre.0 Request processed in 28231us (28447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050255.666952:0:18935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:1.0:1789050255.910412:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050255.910529:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691610880 00000100:00100000:0.0:1789050255.910539:0:18932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691610880 00000100:00100000:0.0:1789050255.910598:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:0.0:1789050255.910609:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd1a549-5106-461c-9c28-9bc689851eed+6:16794:x1875954691610880:12345-192.168.206.1@tcp:101:mkdir.0 00010000:00010000:0.0:1789050255.910629:0:18932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050255.910653:0:18932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7a5be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fdce expref: -99 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050255.910716:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a5c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050255.910730:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050255.910745:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050255.910778:0:18932:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789050255.910781:0:18932:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789050255.910815:0:18932:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050255.910848:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7a5be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fdce expref: 8 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050255.910871:0:18932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fdce expref: 7 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050255.910879:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950714b52900) 00010000:00010000:0.0:1789050255.910882:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789050255.910885:0:18932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f07400, rc 0) 00000100:00100000:0.0:1789050255.910942:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd1a549-5106-461c-9c28-9bc689851eed+7:16794:x1875954691610880:12345-192.168.206.1@tcp:101:mkdir.0 Request processed in 335us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050255.910949:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 8 00010000:00010000:2.0:1789050255.947600:0:20607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050256.526492:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7878f230-1e80-42fc-b48c-88e089c8a2b3:3285:1875954704180480:0@lo:400:kworker.0 00000100:00100000:1.0:1789050256.526623:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050256.526679:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704180992:0@lo:400:kworker.0 00000100:00100000:1.0:1789050256.526716:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050256.526759:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789050256.526765:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704180864:0@lo:400:kworker.0 00000100:00100000:1.0:1789050256.526796:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050256.526889:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704180480 00000100:00100000:1.0:1789050256.526897:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704180480 00000100:00100000:2.0:1789050256.527838:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704180736:0@lo:400:kworker.0 00000100:00100000:1.0:1789050256.527868:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789050256.527880:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:3285:x1875954704180480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050256.527890:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050256.527916:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704181248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050256.527938:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050256.527960:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789050256.527968:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704180608:0@lo:400:kworker.0 00000100:00100000:2.0:1789050256.527995:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050256.528022:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875954704181120:0@lo:400:kworker.0 00000100:00100000:3.0:1789050256.528071:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704180736 00000100:00100000:3.0:1789050256.528078:0:19617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704180736 00000100:00100000:3.0:1789050256.528114:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704180608 00000100:00100000:3.0:1789050256.528118:0:19617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704180608 00000100:00100000:3.0:1789050256.528135:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789050256.528141:0:19617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3283:x1875954704180736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050256.528730:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050256.528771:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704180992 00000100:00100000:2.0:1789050256.528776:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704180992 00000100:00100000:2.0:1789050256.528804:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704180864 00000100:00100000:2.0:1789050256.528807:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704180864 00000100:00100000:2.0:1789050256.528824:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704181120 00000100:00100000:2.0:1789050256.528826:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704181120 00000100:00100000:1.0:1789050256.528839:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:3285:x1875954704180480:12345-0@lo:400:kworker.0 Request processed in 959us (2215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050256.528843:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789050256.528857:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789050256.528858:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704180992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050256.528898:0:19616:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789050256.528917:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704180992:12345-0@lo:400:kworker.0 Request processed in 63us (2201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050256.528923:0:19616:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789050256.528927:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789050256.528945:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789050256.528953:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704180864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050256.528967:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7878f230-1e80-42fc-b48c-88e089c8a2b3:3285:1875954704180480:0@lo:400:kworker.0 00000100:00100000:1.0:1789050256.528985:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704180992:0@lo:400:kworker.0 00000100:00100000:2.0:1789050256.529014:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704180864:12345-0@lo:400:kworker.0 Request processed in 61us (2217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050256.529016:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704180864:0@lo:400:kworker.0 00000100:00100000:2.0:1789050256.529027:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789050256.529045:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789050256.529054:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875954704181120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050256.529090:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875954704181120:12345-0@lo:400:kworker.0 Request processed in 38us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050256.529096:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789050256.529114:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789050256.529118:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789050256.529121:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789050256.529145:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1875954704181120:0@lo:400:kworker.0 00000100:00100000:1.0:1789050256.529163:0:19616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789050256.529174:0:19616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704180608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789050256.529243:0:19616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704180608:12345-0@lo:400:kworker.0 Request processed in 72us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050256.529250:0:19616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789050256.529311:0:19617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3283:x1875954704180736:12345-0@lo:400:kworker.0 Request processed in 1168us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050256.529318:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789050256.529528:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704180608:0@lo:400:kworker.0 00000100:00100000:3.0:1789050256.529548:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704180736:0@lo:400:kworker.0 00000100:00100000:2.0:1789050256.529720:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704181248 00000100:00100000:2.0:1789050256.529724:0:19618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704181248 00000100:00100000:2.0:1789050256.529751:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789050256.529758:0:19618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1875954704181248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789050256.529774:0:19618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789050256.529810:0:19618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1875954704181248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (1871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050256.529816:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789050256.529844:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704181248:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1789050256.609790:0:7634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1789050256.609830:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0fd1a549-5106-461c-9c28-9bc689851eed 00000001:00100000:1.0:1789050256.609870:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789050256.979009:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789050257.995450:0:20603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050258.133376:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050258.133551:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691611008 00000100:00100000:3.0:1789050258.133562:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691611008 00000100:00100000:3.0:1789050258.133630:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:2.0:1789050258.133637:0:18933:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789050258.133644:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+7:16846:x1875954691611008:12345-192.168.206.1@tcp:41:lfs.0 00000100:00100000:2.0:1789050258.133649:0:18933:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000004:00000024:3.0:1789050258.133685:0:18934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789050258.133779:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+7:16846:x1875954691611008:12345-192.168.206.1@tcp:41:lfs.0 Request processed in 139us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050258.133787:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00080000:3.0:1789050258.133810:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789050258.142392:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050258.145672:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691611136 00000100:00100000:0.0:1789050258.145685:0:19618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691611136 00000100:00100000:0.0:1789050258.145801:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00100000:0.0:1789050258.145812:0:19618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0fd1a549-5106-461c-9c28-9bc689851eed+6:16846:x1875954691611136:12345-192.168.206.1@tcp:13:lfs.0 00002000:00000024:0.0:1789050258.145847:0:19618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789050258.145934:0:19618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0fd1a549-5106-461c-9c28-9bc689851eed+6:16846:x1875954691611136:12345-192.168.206.1@tcp:13:lfs.0 Request processed in 123us (3550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050258.145941:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00080000:3.0:1789050258.147332:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1789050258.148834:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0fd1a549-5106-461c-9c28-9bc689851eed 00000100:00100000:3.0:1789050258.154688:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050258.154854:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691611264 00000100:00100000:0.0:1789050258.154864:0:19618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691611264 00000100:00100000:0.0:1789050258.154941:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:0.0:1789050258.154952:0:19618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0fd1a549-5106-461c-9c28-9bc689851eed+5:16846:x1875954691611264:12345-192.168.206.1@tcp:13:lfs.0 00002000:00000024:0.0:1789050258.155005:0:19618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789050258.155092:0:19618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0fd1a549-5106-461c-9c28-9bc689851eed+5:16846:x1875954691611264:12345-192.168.206.1@tcp:13:lfs.0 Request processed in 142us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050258.155100:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00080000:3.0:1789050258.155784:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789050258.395125:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050258.395311:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691611392 00000100:00100000:3.0:1789050258.395320:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691611392 00000100:00100000:3.0:1789050258.395369:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 92 00000100:00100000:3.0:1789050258.395385:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+10:16880:x1875954691611392:12345-192.168.206.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789050258.395400:0:18926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050258.395415:0:18926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950703331200/0x9df728c939b7a5cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fdd5 expref: -99 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050258.395439:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950703331200/0x9df728c939b7a5cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fdd5 expref: 11 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050258.395449:0:18926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950703331200/0x9df728c939b7a5cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fdd5 expref: 11 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050258.395457:0:18926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331200, rc 0) 00000100:00100000:3.0:1789050258.395519:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+11:16880:x1875954691611392:12345-192.168.206.1@tcp:101:mount.lustre.0 Request processed in 143us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050258.395526:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 92 00000100:00100000:2.0:1789050258.406135:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050258.407883:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691611520 00000100:00100000:1.0:1789050258.407896:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691611520 00000100:00100000:1.0:1789050258.407967:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 93 00000100:00100000:1.0:1789050258.407977:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+11:16880:x1875954691611520:12345-192.168.206.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789050258.408977:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+11:16880:x1875954691611520:12345-192.168.206.1@tcp:501:mount.lustre.0 Request processed in 998us (2847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050258.408987:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 93 00000100:00100000:0.0:1789050258.411171:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050258.411517:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691611648 00000100:00100000:1.0:1789050258.411526:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691611648 00000100:00100000:1.0:1789050258.411579:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 94 00000100:00100000:1.0:1789050258.411588:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+11:16880:x1875954691611648:12345-192.168.206.1@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789050258.412164:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+11:16880:x1875954691611648:12345-192.168.206.1@tcp:503:mount.lustre.0 Request processed in 444us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050258.412173:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 94 00000100:00100000:2.0:1789050258.418558:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050258.418644:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691611776 00000100:00100000:1.0:1789050258.418653:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691611776 00000100:00100000:1.0:1789050258.418714:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 95 00000100:00100000:1.0:1789050258.418725:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+11:16885:x1875954691611776:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789050258.419088:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+11:16885:x1875954691611776:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 356us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050258.419097:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 95 00000100:00100000:2.0:1789050258.449335:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050258.449429:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691611904 00000100:00100000:3.0:1789050258.449439:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691611904 00000100:00100000:3.0:1789050258.449490:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 96 00000100:00100000:3.0:1789050258.449499:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+11:16885:x1875954691611904:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789050258.449779:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+11:16885:x1875954691611904:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 281us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050258.449788:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 96 00000100:00100000:3.0:1789050258.478327:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050258.479791:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691612032 00000100:00100000:0.0:1789050258.479802:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691612032 00000100:00100000:0.0:1789050258.479859:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 97 00000100:00100000:0.0:1789050258.479867:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+11:16880:x1875954691612032:12345-192.168.206.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789050258.479881:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050258.479896:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950605f07c00/0x9df728c939b7a5d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fdff expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050258.479920:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950605f07c00/0x9df728c939b7a5d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fdff expref: 12 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050258.479930:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950605f07c00/0x9df728c939b7a5d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fdff expref: 12 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050258.479938:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f07c00, rc 0) 00000100:00100000:0.0:1789050258.479992:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+12:16880:x1875954691612032:12345-192.168.206.1@tcp:101:mount.lustre.0 Request processed in 125us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050258.479999:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 97 00000100:00100000:2.0:1789050258.483285:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050258.484124:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691612160 00000100:00100000:1.0:1789050258.484149:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691612160 00000100:00100000:1.0:1789050258.484218:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 98 00000100:00100000:1.0:1789050258.484229:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+12:16880:x1875954691612160:12345-192.168.206.1@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789050258.484251:0:18925:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789050258.484267:0:18925:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789050258.484271:0:18925:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789050258.484274:0:18925:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789050258.484277:0:18925:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:1.0:1789050258.492662:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+12:16880:x1875954691612160:12345-192.168.206.1@tcp:256:mount.lustre.0 Request processed in 8426us (9375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050258.492677:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 98 00000100:00100000:3.0:1789050258.499421:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050258.499502:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691612288 00000100:00100000:2.0:1789050258.499522:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691612288 00000100:00100000:2.0:1789050258.499580:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 99 00000100:00100000:2.0:1789050258.499590:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+12:16880:x1875954691612288:12345-192.168.206.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789050258.499606:0:18926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050258.499622:0:18926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950701489200/0x9df728c939b7a5da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fe06 expref: -99 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050258.499649:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950701489200/0x9df728c939b7a5da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe06 expref: 13 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050258.499661:0:18926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950701489200/0x9df728c939b7a5da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe06 expref: 13 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050258.499669:0:18926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950701489200, rc 0) 00000100:00100000:2.0:1789050258.499740:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+13:16880:x1875954691612288:12345-192.168.206.1@tcp:101:mount.lustre.0 Request processed in 151us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050258.499747:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 99 00000100:00100000:2.0:1789050258.506367:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050258.506537:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691612416 00000100:00100000:1.0:1789050258.506547:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691612416 00000100:00100000:1.0:1789050258.506660:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 100 00000100:00100000:1.0:1789050258.506671:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+13:16880:x1875954691612416:12345-192.168.206.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789050258.506948:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+13:16880:x1875954691612416:12345-192.168.206.1@tcp:501:mount.lustre.0 Request processed in 279us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050258.506956:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 100 00000100:00100000:3.0:1789050258.509827:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050258.516253:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691612544 00000100:00100000:2.0:1789050258.516267:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691612544 00000100:00100000:2.0:1789050258.516322:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 101 00000100:00100000:2.0:1789050258.516332:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+13:16880:x1875954691612544:12345-192.168.206.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789050258.516688:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+13:16880:x1875954691612544:12345-192.168.206.1@tcp:503:mount.lustre.0 Request processed in 356us (6869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050258.516704:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 101 00000100:00100000:3.0:1789050258.522423:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050258.522797:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691612672 00000100:00100000:1.0:1789050258.522811:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691612672 00000100:00100000:1.0:1789050258.522884:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 102 00000100:00100000:1.0:1789050258.522894:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+13:16889:x1875954691612672:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789050258.523422:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+13:16889:x1875954691612672:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 526us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050258.523431:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 102 00000100:00100000:3.0:1789050258.533452:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050258.533799:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691612800 00000100:00100000:2.0:1789050258.533815:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691612800 00000100:00100000:2.0:1789050258.533893:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 103 00000100:00100000:2.0:1789050258.533904:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+13:16889:x1875954691612800:12345-192.168.206.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789050258.534146:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+13:16889:x1875954691612800:12345-192.168.206.1@tcp:502:llog_process_th.0 Request processed in 242us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050258.534153:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 103 00000100:00100000:3.0:1789050258.538491:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050258.539338:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691612928 00000100:00100000:1.0:1789050258.539373:0:18932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691612928 00000100:00100000:1.0:1789050258.539433:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:1.0:1789050258.539442:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2346:x1875954691612928:12345-192.168.206.1@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789050258.539481:0:18932:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 1940353c-2b2a-4224-bbac-3372d105601d@192.168.206.1@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:1.0:1789050258.539545:0:18932:0:(genops.c:1384:class_connect()) connect: client 1940353c-2b2a-4224-bbac-3372d105601d, cookie 0x9df728c939b7a5e1 00000004:00100000:1.0:1789050258.539584:0:18932:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789050258.539749:0:18932:0:(import.c:65:import_set_state_nolock()) ffff95070ab95000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789050258.540049:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1940353c-2b2a-4224-bbac-3372d105601d+6:2346:x1875954691612928:12345-192.168.206.1@tcp:38:mount.lustre.0 Request processed in 605us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050258.540058:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:3.0:1789050258.543594:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050258.543641:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050258.543759:0:20811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691613184 00000100:00100000:0.0:1789050258.543772:0:20811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691613184 00000100:00100000:0.0:1789050258.543867:0:20811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691613056 00000100:00100000:0.0:1789050258.543871:0:20811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691613056 00000100:00100000:0.0:1789050258.543905:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:0.0:1789050258.543934:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1940353c-2b2a-4224-bbac-3372d105601d+7:16880:x1875954691613184:12345-192.168.206.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789050258.543974:0:18932:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789050258.544051:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1940353c-2b2a-4224-bbac-3372d105601d+7:16880:x1875954691613184:12345-192.168.206.1@tcp:41:mount.lustre.0 Request processed in 120us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050258.544060:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:0.0:1789050258.544095:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 12 00000100:00100000:0.0:1789050258.544104:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1940353c-2b2a-4224-bbac-3372d105601d+6:0:x1875954691613056:12345-192.168.206.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789050258.544117:0:18932:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789050258.544144:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1940353c-2b2a-4224-bbac-3372d105601d+6:0:x1875954691613056:12345-192.168.206.1@tcp:41:mount.lustre.0 Request processed in 41us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050258.544154:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 12 00000100:00080000:3.0:1789050258.544562:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789050258.547407:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050258.548099:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691613312 00000100:00100000:2.0:1789050258.548113:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691613312 00000100:00100000:2.0:1789050258.548185:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 13 00000100:00100000:2.0:1789050258.548196:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1940353c-2b2a-4224-bbac-3372d105601d+6:16880:x1875954691613312:12345-192.168.206.1@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789050258.548336:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1940353c-2b2a-4224-bbac-3372d105601d+6:16880:x1875954691613312:12345-192.168.206.1@tcp:40:mount.lustre.0 Request processed in 141us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050258.548344:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 13 00000100:00100000:2.0:1789050258.557736:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050258.557790:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050258.557850:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050258.558011:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691613440 00000100:00100000:0.0:1789050258.558025:0:19617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691613440 00000100:00100000:0.0:1789050258.558092:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691613568 00000100:00100000:0.0:1789050258.558096:0:19617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691613568 00000100:00100000:0.0:1789050258.558120:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:0.0:1789050258.558130:0:19617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875954691613440:12345-192.168.206.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789050258.558171:0:19617:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1940353c-2b2a-4224-bbac-3372d105601d@192.168.206.1@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:0.0:1789050258.558479:0:19617:0:(genops.c:1384:class_connect()) connect: client 1940353c-2b2a-4224-bbac-3372d105601d, cookie 0x9df728c939b7a5e8 00002000:00100000:0.0:1789050258.558495:0:19617:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1940353c-2b2a-4224-bbac-3372d105601d/ffff950605767800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789050258.558518:0:19617:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789050258.558813:0:19617:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1789050258.558973:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691613696 00000100:00100000:1.0:1789050258.558980:0:18936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691613696 00000100:00100000:1.0:1789050258.559028:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 1 00000100:00100000:1.0:1789050258.559050:0:18936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1940353c-2b2a-4224-bbac-3372d105601d+6:16880:x1875954691613696:12345-192.168.206.1@tcp:33:mount.lustre.0 00000100:00080000:0.0:1789050258.561416:0:19617:0:(import.c:65:import_set_state_nolock()) ffff950605762800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789050258.561560:0:19617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1940353c-2b2a-4224-bbac-3372d105601d+6:2346:x1875954691613440:12345-192.168.206.1@tcp:8:mount.lustre.0 Request processed in 3425us (3833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050258.561592:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:0.0:1789050258.561636:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:0.0:1789050258.561644:0:19617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875954691613568:12345-192.168.206.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789050258.561677:0:19617:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1940353c-2b2a-4224-bbac-3372d105601d@192.168.206.1@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:0.0:1789050258.561712:0:19617:0:(genops.c:1384:class_connect()) connect: client 1940353c-2b2a-4224-bbac-3372d105601d, cookie 0x9df728c939b7a5ef 00002000:00100000:0.0:1789050258.561727:0:19617:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1940353c-2b2a-4224-bbac-3372d105601d/ffff950605762000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789050258.561739:0:19617:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000004:00200000:1.0:1789050258.561998:0:18936:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789050258.562062:0:18936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1940353c-2b2a-4224-bbac-3372d105601d+6:16880:x1875954691613696:12345-192.168.206.1@tcp:33:mount.lustre.0 Request processed in 3025us (4270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050258.562071:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 1 00002000:00080000:0.0:1789050258.563485:0:19617:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789050258.563548:0:19617:0:(import.c:65:import_set_state_nolock()) ffff950605761800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789050258.563628:0:19617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1940353c-2b2a-4224-bbac-3372d105601d+6:2346:x1875954691613568:12345-192.168.206.1@tcp:8:mount.lustre.0 Request processed in 1982us (5776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050258.563640:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:2.0:1789050258.793597:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050258.793710:0:20811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691613824 00000100:00100000:0.0:1789050258.793723:0:20811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691613824 00000100:00100000:0.0:1789050258.793810:0:20811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:0.0:1789050258.793823:0:20811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1940353c-2b2a-4224-bbac-3372d105601d+6:16911:x1875954691613824:12345-192.168.206.1@tcp:101:mkdir.0 00010000:00010000:0.0:1789050258.793857:0:20811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050258.793885:0:20811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7a5f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fe30 expref: -99 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050258.793966:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a5fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050258.793983:0:20811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a5fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050258.794020:0:20811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a5fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050258.794067:0:20811:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789050258.794071:0:20811:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789050258.794105:0:20811:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a5fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050258.794135:0:20811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7a5f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe30 expref: 8 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050258.794165:0:20811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a5fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe30 expref: 7 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050258.794175:0:20811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950714b52900) 00010000:00010000:0.0:1789050258.794179:0:20811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789050258.794183:0:20811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06c00, rc 0) 00000100:00100000:0.0:1789050258.794627:0:20811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1940353c-2b2a-4224-bbac-3372d105601d+7:16911:x1875954691613824:12345-192.168.206.1@tcp:101:mkdir.0 Request processed in 804us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050258.794637:0:20811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 14 00010000:00010000:0.0:1789050259.024686:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050259.597402:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789050259.597431:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704181376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050259.597530:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050259.597730:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704181376 00000100:00100000:1.0:1789050259.597741:0:19618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704181376 00000100:00100000:1.0:1789050259.597836:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789050259.597849:0:19618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704181376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789050259.597878:0:19618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789050259.597932:0:19618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704181376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050259.597940:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1789050259.598228:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789050259.598273:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704181376:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789050260.043763:0:20607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789050260.657607:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1940353c-2b2a-4224-bbac-3372d105601d 00000001:00100000:0.0:1789050260.658566:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0fd1a549-5106-461c-9c28-9bc689851eed 00010000:00010000:2.0:1789050261.067475:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789050261.331725:0:18964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789050261.650533:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7878f230-1e80-42fc-b48c-88e089c8a2b3:3285:1875954704181504:0@lo:400:kworker.0 00000100:00100000:2.0:1789050261.650611:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050261.650668:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704182016:0@lo:400:kworker.0 00000100:00100000:2.0:1789050261.650699:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050261.650744:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789050261.650752:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c25b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704181888:0@lo:400:kworker.0 00000100:00100000:2.0:1789050261.650781:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050261.650813:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704181632:0@lo:400:kworker.0 00000100:00100000:2.0:1789050261.650844:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050261.650865:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875954704182144:0@lo:400:kworker.0 00000100:00100000:2.0:1789050261.650889:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050261.650912:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789050261.650918:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704181760:0@lo:400:kworker.0 00000100:00100000:2.0:1789050261.650938:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050261.650991:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704181504 00000100:00100000:2.0:1789050261.650999:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704181504 00000100:00100000:2.0:1789050261.651044:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789050261.651053:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:3285:x1875954704181504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050261.651102:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:3285:x1875954704181504:12345-0@lo:400:kworker.0 Request processed in 50us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050261.651109:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789050261.651139:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704182016 00000100:00100000:2.0:1789050261.651143:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704182016 00000100:00100000:2.0:1789050261.651176:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704181888 00000100:00100000:2.0:1789050261.651179:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704181888 00000100:00100000:2.0:1789050261.651191:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704182144 00000100:00100000:2.0:1789050261.651194:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704182144 00000100:00100000:2.0:1789050261.651229:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789050261.651236:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704182016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050261.651269:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704182016:12345-0@lo:400:kworker.0 Request processed in 33us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050261.651274:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789050261.651295:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789050261.651300:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704181888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050261.651329:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875954704181888:12345-0@lo:400:kworker.0 Request processed in 29us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050261.651333:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789050261.651343:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789050261.651348:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875954704182144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050261.651377:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875954704182144:12345-0@lo:400:kworker.0 Request processed in 29us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050261.651382:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789050261.651402:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704181632 00000100:00100000:2.0:1789050261.651405:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704181632 00000100:00100000:2.0:1789050261.651427:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704181760 00000100:00100000:2.0:1789050261.651429:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704181760 00000100:00100000:2.0:1789050261.651447:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789050261.651453:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704181632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050261.651480:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704181632:12345-0@lo:400:kworker.0 Request processed in 27us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050261.651485:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789050261.651507:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789050261.651513:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704181760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789050261.651535:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704181760:12345-0@lo:400:kworker.0 Request processed in 23us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050261.651541:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789050261.651650:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c25b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875954704181888:0@lo:400:kworker.0 00000100:00100000:2.0:1789050261.651659:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7878f230-1e80-42fc-b48c-88e089c8a2b3:3285:1875954704181504:0@lo:400:kworker.0 00000100:00100000:2.0:1789050261.651678:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704182016:0@lo:400:kworker.0 00000100:00080000:2.0:1789050261.651703:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789050261.651707:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789050261.651709:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050261.651725:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1789050261.651734:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704181760:0@lo:400:kworker.0 00000100:00100000:2.0:1789050261.651742:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704181632:0@lo:400:kworker.0 00000100:00100000:2.0:1789050261.651750:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1875954704182144:0@lo:400:kworker.0 00000100:00100000:0.0:1789050261.653993:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050261.654012:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704182272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789050261.654080:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050261.654839:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704182272 00000100:00100000:1.0:1789050261.654847:0:19618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704182272 00000100:00100000:1.0:1789050261.654905:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789050261.654914:0:19618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704182272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789050261.654948:0:19618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789050261.655018:0:19618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704182272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050261.655026:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789050261.655485:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704182272:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1789050261.723369:0:7634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1940353c-2b2a-4224-bbac-3372d105601d 00000001:02000400:1.0:1789050261.763831:0:20897:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789050262.091570:0:20603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050263.123572:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789050263.263659:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1940353c-2b2a-4224-bbac-3372d105601d 00000100:00100000:2.0:1789050263.763224:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050263.763269:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050263.763315:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050263.764120:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691614080 00000100:00100000:3.0:1789050263.764131:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691614080 00000100:00100000:3.0:1789050263.764221:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 19 00000100:00100000:3.0:1789050263.764231:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+6:2350:x1875954691614080:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:3.0:1789050263.764305:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+6:2350:x1875954691614080:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 75us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050263.764312:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 19 00000100:00080000:3.0:1789050263.764416:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789050263.764566:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050263.764673:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050263.764698:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050263.764721:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050263.764744:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691614336 00000100:00100000:2.0:1789050263.764749:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691614336 00000100:00100000:2.0:1789050263.764912:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691614208 00000100:00100000:2.0:1789050263.764917:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691614208 00000100:00100000:2.0:1789050263.764934:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691614592 00000100:00100000:2.0:1789050263.764936:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691614592 00000100:00100000:2.0:1789050263.764947:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691614720 00000100:00100000:2.0:1789050263.764949:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691614720 00000100:00100000:2.0:1789050263.764961:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:2.0:1789050263.764969:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0fd1a549-5106-461c-9c28-9bc689851eed+5:2350:x1875954691614336:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050263.765024:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0fd1a549-5106-461c-9c28-9bc689851eed+5:2350:x1875954691614336:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 55us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050263.765032:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:2.0:1789050263.765046:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:2.0:1789050263.765053:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0fd1a549-5106-461c-9c28-9bc689851eed+5:2349:x1875954691614208:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050263.765077:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0fd1a549-5106-461c-9c28-9bc689851eed+5:2349:x1875954691614208:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 25us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050263.765083:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:2.0:1789050263.765093:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:2.0:1789050263.765100:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1940353c-2b2a-4224-bbac-3372d105601d+5:2350:x1875954691614592:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050263.765120:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1940353c-2b2a-4224-bbac-3372d105601d+5:2350:x1875954691614592:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 21us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050263.765126:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:2.0:1789050263.765136:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:2.0:1789050263.765142:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c25b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1940353c-2b2a-4224-bbac-3372d105601d+5:2349:x1875954691614720:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050263.765161:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c25b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1940353c-2b2a-4224-bbac-3372d105601d+5:2349:x1875954691614720:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 20us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050263.765167:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:2.0:1789050263.765186:0:20811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691614464 00000100:00100000:2.0:1789050263.765189:0:20811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691614464 00000100:00100000:2.0:1789050263.765248:0:20811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 20 00000100:00100000:2.0:1789050263.765254:0:20811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1940353c-2b2a-4224-bbac-3372d105601d+6:2349:x1875954691614464:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050263.765292:0:20811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1940353c-2b2a-4224-bbac-3372d105601d+6:2349:x1875954691614464:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 37us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050263.765305:0:20811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 20 00000100:00100000:1.0:1789050263.766286:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691613952 00000100:00100000:1.0:1789050263.766294:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691613952 00000100:00100000:1.0:1789050263.766337:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 105 00000100:00100000:1.0:1789050263.766357:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+13:2349:x1875954691613952:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:1.0:1789050263.766395:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+13:2349:x1875954691613952:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 40us (3127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050263.766401:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 105 00000100:00080000:3.0:1789050263.767105:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789050263.767112:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789050263.767114:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789050264.139507:0:20607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050264.716343:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704182400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050264.716423:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050264.716760:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704182400 00000100:00100000:0.0:1789050264.716769:0:19618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704182400 00000100:00100000:0.0:1789050264.716824:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789050264.716833:0:19618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704182400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789050264.716869:0:19618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789050264.716913:0:19618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704182400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050264.716921:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789050264.716972:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704182400:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789050264.717637:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1789050265.127419:0:21047:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5d2ca350 20000000:00000080:1.0:1789050265.127434:0:21047:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff950606eff000 uarg=0000000000000000 20000000:01000000:1.0:1789050265.127477:0:21047:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789050265.127483:0:21047:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789050265.127488:0:21047:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789050265.129415:0:21048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1789050265.129611:0:21047:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789050265.138425:0:21047:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789050265.138481:0:21047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff950605cf9800/0x9df728c939b7a604 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050265.138502:0:21047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95073bc0f800/0x9df728c939b7a2c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a2bc expref: 18 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050265.138510:0:21047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950605f06a00/0x9df728c939b7a310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a309 expref: 18 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050265.138517:0:21047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950702c51800/0x9df728c939b7a467 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a460 expref: 18 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050265.138526:0:21047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950605f06e00/0x9df728c939b7a5a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fda4 expref: 12 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050265.138533:0:21047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff950701489200/0x9df728c939b7a5da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe06 expref: 12 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050265.138540:0:21047:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff950605cf9800/0x9df728c939b7a604 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050265.138582:0:21047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950701489200/0x9df728c939b7a5da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe06 expref: 12 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050265.138597:0:21047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff950701489200/0x9df728c939b7a5da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe06 expref: 12 pid: 18926 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050265.138610:0:21047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c514000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21047:1875954704182528:192.168.206.1@tcp:104: 00010000:00010000:1.0:1789050265.138749:0:21047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950605f06e00/0x9df728c939b7a5a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fda4 expref: 12 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050265.138769:0:21047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff950605f06e00/0x9df728c939b7a5a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fda4 expref: 12 pid: 18927 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050265.138778:0:21047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c517100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21047:1875954704182656:192.168.206.1@tcp:104: 00010000:00010000:1.0:1789050265.138815:0:21047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950702c51800/0x9df728c939b7a467 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b7a460 expref: 18 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050265.138824:0:21047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff950702c51800/0x9df728c939b7a467 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b7a460 expref: 18 pid: 18926 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050265.138832:0:21047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c514380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21047:1875954704182784:0@lo:104: 00000100:00100000:1.0:1789050265.138869:0:21047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789050265.138916:0:21047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff950605f06a00/0x9df728c939b7a310 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b7a309 expref: 18 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050265.138924:0:21047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff950605f06a00/0x9df728c939b7a310 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b7a309 expref: 18 pid: 18925 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050265.138932:0:21047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21047:1875954704182912:0@lo:104: 00000100:00100000:1.0:1789050265.139630:0:21047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789050265.139667:0:21047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95073bc0f800/0x9df728c939b7a2c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9df728c939b7a2bc expref: 18 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050265.139677:0:21047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95073bc0f800/0x9df728c939b7a2c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9df728c939b7a2bc expref: 18 pid: 18927 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050265.139687:0:21047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21047:1875954704183040:0@lo:104: 00000100:00100000:1.0:1789050265.139716:0:21047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050265.139737:0:21047:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606cd43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789050265.140325:0:18915:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789050265.140339:0:18915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704182784 00000100:00100000:0.0:1789050265.140347:0:18915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704182784 00000100:00100000:0.0:1789050265.140381:0:18915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704182912 00000100:00100000:0.0:1789050265.140384:0:18915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704182912 00000100:00100000:0.0:1789050265.140396:0:18915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704183040 00000100:00100000:0.0:1789050265.140398:0:18915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704183040 00000100:00100000:0.0:1789050265.140411:0:18915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789050265.140419:0:18915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c517800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7878f230-1e80-42fc-b48c-88e089c8a2b3+5:21047:x1875954704182784:12345-0@lo:104: 00010000:00010000:0.0:1789050265.140431:0:18915:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950702c51600/0x9df728c939b7a460 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7a467 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.140516:0:18915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789050265.140523:0:18915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c517800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7878f230-1e80-42fc-b48c-88e089c8a2b3+5:21047:x1875954704182784:12345-0@lo:104: Request processed in 105us (1654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050265.140530:0:18915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789050265.140549:0:18915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789050265.140556:0:18915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720824e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7878f230-1e80-42fc-b48c-88e089c8a2b3+4:21047:x1875954704182912:12345-0@lo:104: 00010000:00010000:0.0:1789050265.140563:0:18915:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950703330800/0x9df728c939b7a309 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7a310 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.140609:0:18915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789050265.140614:0:18915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720824e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7878f230-1e80-42fc-b48c-88e089c8a2b3+4:21047:x1875954704182912:12345-0@lo:104: Request processed in 60us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050265.140620:0:18915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789050265.140632:0:18915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789050265.140637:0:18915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c036c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7878f230-1e80-42fc-b48c-88e089c8a2b3+3:21047:x1875954704183040:12345-0@lo:104: 00010000:00010000:0.0:1789050265.140644:0:18915:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.101@tcp lock: ffff950702c50000/0x9df728c939b7a2bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7a2c3 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.140673:0:18915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789050265.140678:0:18915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c036c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7878f230-1e80-42fc-b48c-88e089c8a2b3+3:21047:x1875954704183040:12345-0@lo:104: Request processed in 41us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050265.140683:0:18915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789050265.140718:0:20603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789050265.140723:0:20603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950702c51600/0x9df728c939b7a460 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7a467 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.140740:0:20603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c51600 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789050265.140744:0:20603:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950702c51600/0x9df728c939b7a460 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b7a467 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.140752:0:20603:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950702c51600/0x9df728c939b7a460 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b7a467 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050265.140757:0:20603:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950702c51600/0x9df728c939b7a460 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b7a467 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050265.140762:0:20603:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789050265.140790:0:20603:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950702c51600/0x9df728c939b7a460 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a467 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.140796:0:20603:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050265.140814:0:20603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950702c51600/0x9df728c939b7a460 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a467 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.140820:0:20603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950702c51600/0x9df728c939b7a460 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a467 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.140833:0:20603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789050265.140836:0:20603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950703330800/0x9df728c939b7a309 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7a310 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.140841:0:20603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330800 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789050265.140844:0:20603:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950703330800/0x9df728c939b7a309 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b7a310 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.140859:0:20603:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950703330800/0x9df728c939b7a309 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b7a310 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050265.140866:0:20603:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950703330800/0x9df728c939b7a309 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b7a310 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050265.140870:0:20603:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789050265.140884:0:20603:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950703330800/0x9df728c939b7a309 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a310 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.140889:0:20603:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050265.140904:0:20603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950703330800/0x9df728c939b7a309 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a310 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.140910:0:20603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950703330800/0x9df728c939b7a309 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a310 expref: -99 pid: 19613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.140919:0:20603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789050265.140922:0:20603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.101@tcp lock: ffff950702c50000/0x9df728c939b7a2bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9df728c939b7a2c3 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.140926:0:20603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950702c50000 already unused, calling callback (ffffffffc1e0fc20) 10000000:00010000:0.0:1789050265.140929:0:20603:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.101@tcp lock: ffff950702c50000/0x9df728c939b7a2bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9df728c939b7a2c3 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.140935:0:20603:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.101@tcp lock: ffff950702c50000/0x9df728c939b7a2bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9df728c939b7a2c3 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789050265.140941:0:20603:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.101@tcp lock: ffff950702c50000/0x9df728c939b7a2bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9df728c939b7a2c3 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789050265.140952:0:20603:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789050265.141151:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050265.142157:0:20603:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.101@tcp lock: ffff950702c50000/0x9df728c939b7a2bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a2c3 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.142169:0:20603:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789050265.142182:0:20603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.101@tcp lock: ffff950702c50000/0x9df728c939b7a2bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a2c3 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.142188:0:20603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.101@tcp lock: ffff950702c50000/0x9df728c939b7a2bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9df728c939b7a2c3 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.142435:0:20603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050265.142438:0:20603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050265.142440:0:20603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789050265.142447:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050265.142481:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7878f230-1e80-42fc-b48c-88e089c8a2b3:3285:1875954704183168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050265.142542:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050265.144802:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7878f230-1e80-42fc-b48c-88e089c8a2b3:3282:1875954704183296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050265.144871:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050265.144913:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789050265.144921:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7878f230-1e80-42fc-b48c-88e089c8a2b3:3282:1875954704183424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050265.144944:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050265.144980:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704183168 00000100:00100000:0.0:1789050265.144988:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704183168 00010000:00010000:0.0:1789050265.145021:0:18919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950702c51800/0x9df728c939b7a467 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7a460 expref: 19 pid: 18926 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050265.145041:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704183296 00000100:00100000:0.0:1789050265.145057:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704183296 00010000:00010000:0.0:1789050265.145069:0:18919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950605f06a00/0x9df728c939b7a310 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7a309 expref: 20 pid: 18925 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050265.145081:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704183424 00000100:00100000:0.0:1789050265.145084:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704183424 00010000:00010000:0.0:1789050265.145094:0:18919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95073bc0f800/0x9df728c939b7a2c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7a2bc expref: 21 pid: 18927 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050265.145108:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789050265.145116:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7878f230-1e80-42fc-b48c-88e089c8a2b3+21:3285:x1875954704183168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050265.145130:0:18919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050265.145135:0:18919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950702c51800/0x9df728c939b7a467 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7a460 expref: 21 pid: 18926 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.145145:0:18919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950702c51800/0x9df728c939b7a467 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b7a460 expref: 21 pid: 18926 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.145163:0:18919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050265.145216:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7878f230-1e80-42fc-b48c-88e089c8a2b3+21:3285:x1875954704183168:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (2654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050265.145223:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789050265.145240:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789050265.145246:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7878f230-1e80-42fc-b48c-88e089c8a2b3+20:3282:x1875954704183296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050265.145253:0:18919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050265.145257:0:18919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950605f06a00/0x9df728c939b7a310 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7a309 expref: 20 pid: 18925 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.145266:0:18919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950605f06a00/0x9df728c939b7a310 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b7a309 expref: 20 pid: 18925 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.145286:0:18919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050265.145316:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7878f230-1e80-42fc-b48c-88e089c8a2b3+20:3282:x1875954704183296:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050265.145322:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789050265.145335:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789050265.145341:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507101b3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:3282:x1875954704183424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789050265.145349:0:18919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050265.145353:0:18919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95073bc0f800/0x9df728c939b7a2c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9df728c939b7a2bc expref: 19 pid: 18927 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.145361:0:18919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95073bc0f800/0x9df728c939b7a2c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9df728c939b7a2bc expref: 19 pid: 18927 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.145371:0:18919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050265.145392:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507101b3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:3282:x1875954704183424:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050265.145398:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789050265.145457:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7878f230-1e80-42fc-b48c-88e089c8a2b3:3282:1875954704183424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050265.145465:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7878f230-1e80-42fc-b48c-88e089c8a2b3:3282:1875954704183296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789050265.145501:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7878f230-1e80-42fc-b48c-88e089c8a2b3:3285:1875954704183168:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789050265.145718:0:21047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950702c51800/0x9df728c939b7a467 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b7a460 expref: 18 pid: 18926 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050265.145731:0:21047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c514380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21047:1875954704182784:0@lo:104: 00010000:00010000:1.0:1789050265.145740:0:21047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950605f06a00/0x9df728c939b7a310 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b7a309 expref: 17 pid: 18925 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050265.145755:0:21047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21047:1875954704182912:0@lo:104: 00010000:00010000:1.0:1789050265.145764:0:21047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95073bc0f800/0x9df728c939b7a2c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9df728c939b7a2bc expref: 16 pid: 18927 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050265.145772:0:21047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21047:1875954704183040:0@lo:104: 00000100:00100000:1.0:1789050265.152154:0:21047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c514000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21047:1875954704182528:192.168.206.1@tcp:104: 00000100:00100000:1.0:1789050265.152169:0:21047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c517100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21047:1875954704182656:192.168.206.1@tcp:104: 00010000:00010000:1.0:1789050265.152239:0:21047:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff950605cf9800/0x9df728c939b7a604 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050265.156616:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050265.156722:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691614848 00000100:00100000:0.0:1789050265.156732:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691614848 00010000:00010000:0.0:1789050265.156767:0:18919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950701489200/0x9df728c939b7a5da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe06 expref: 13 pid: 18926 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050265.156807:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:0.0:1789050265.156823:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c273480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+13:2348:x1875954691614848:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050265.156837:0:18919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050265.156843:0:18919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950701489200/0x9df728c939b7a5da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe06 expref: 13 pid: 18926 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.156855:0:18919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950701489200/0x9df728c939b7a5da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe06 expref: 13 pid: 18926 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.156872:0:18919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950701489200/0x9df728c939b7a5da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe06 expref: 13 pid: 18926 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050265.156889:0:18919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050265.156942:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c273480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+12:2348:x1875954691614848:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 120us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050265.156949:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:0.0:1789050265.160400:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050265.160539:0:18918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691614976 00000100:00100000:2.0:1789050265.160548:0:18918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691614976 00010000:00010000:2.0:1789050265.160581:0:18918:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff950605f06e00/0x9df728c939b7a5a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fda4 expref: 12 pid: 18927 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050265.160618:0:18918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:2.0:1789050265.160628:0:18918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+12:2348:x1875954691614976:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050265.160641:0:18918:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050265.160647:0:18918:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff950605f06e00/0x9df728c939b7a5a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fda4 expref: 12 pid: 18927 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050265.160658:0:18918:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff950605f06e00/0x9df728c939b7a5a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fda4 expref: 12 pid: 18927 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050265.160675:0:18918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950605f06e00/0x9df728c939b7a5a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fda4 expref: 12 pid: 18927 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050265.160697:0:18918:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff950605cf9800/0x9df728c939b7a604 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050265.160705:0:18918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950605cf9800/0x9df728c939b7a604 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050265.160720:0:18918:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950605cf9800/0x9df728c939b7a604 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050265.160727:0:18918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff950605cf9800/0x9df728c939b7a604 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050265.160748:0:18918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff950605cf9800/0x9df728c939b7a604 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050265.160755:0:18918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff950605cf9800/0x9df728c939b7a604 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050265.160761:0:18918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605cf9800 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050265.160765:0:18918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff950605cf9800/0x9df728c939b7a604 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050265.160773:0:18918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff950605cf9800/0x9df728c939b7a604 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050265.160792:0:18918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff950605cf9800/0x9df728c939b7a604 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050265.160810:0:18918:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050265.160864:0:18918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+11:2348:x1875954691614976:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 238us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050265.160872:0:18918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 8 00010000:00010000:1.0:1789050265.160937:0:21047:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff950605cf9800/0x9df728c939b7a604 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050265.160945:0:21047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff950605cf9800/0x9df728c939b7a604 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050265.160951:0:21047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff950605cf9800/0x9df728c939b7a604 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050265.176152:0:20607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789050266.187338:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050266.260336:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050266.260435:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691615104 00000100:00100000:1.0:1789050266.260444:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691615104 00000100:00100000:1.0:1789050266.260518:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 106 00000100:00100000:1.0:1789050266.260526:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+11:16764:x1875954691615104:12345-192.168.206.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050266.260540:0:18925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050266.260558:0:18925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950605cf9800/0x9df728c939b7a60b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fe37 expref: -99 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.260581:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950605cf9800/0x9df728c939b7a60b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe37 expref: 12 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.260591:0:18925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950605cf9800/0x9df728c939b7a60b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe37 expref: 12 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.260599:0:18925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605cf9800, rc 0) 00000100:00100000:1.0:1789050266.260655:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+12:16764:x1875954691615104:12345-192.168.206.1@tcp:101:ll_cfg_requeue.0 Request processed in 129us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050266.260663:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 106 00000100:00100000:3.0:1789050266.268293:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050266.268428:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691615232 00000100:00100000:2.0:1789050266.268438:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691615232 00000100:00100000:2.0:1789050266.268506:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 107 00000100:00100000:2.0:1789050266.268516:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+12:16764:x1875954691615232:12345-192.168.206.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050266.268883:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+12:16764:x1875954691615232:12345-192.168.206.1@tcp:501:ll_cfg_requeue.0 Request processed in 368us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050266.268892:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 107 00000100:00100000:0.0:1789050266.276133:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050266.276471:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691615360 00000100:00100000:2.0:1789050266.276481:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691615360 00000100:00100000:2.0:1789050266.276534:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 108 00000100:00100000:2.0:1789050266.276543:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+12:16764:x1875954691615360:12345-192.168.206.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050266.276747:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+12:16764:x1875954691615360:12345-192.168.206.1@tcp:503:ll_cfg_requeue.0 Request processed in 204us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050266.276755:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 108 00000100:00100000:3.0:1789050266.292657:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050266.296052:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691615488 00000100:00100000:0.0:1789050266.296071:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691615488 00000100:00100000:0.0:1789050266.296142:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 109 00000100:00100000:0.0:1789050266.296153:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+12:16764:x1875954691615488:12345-192.168.206.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789050266.296171:0:18927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050266.296191:0:18927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950605f06200/0x9df728c939b7a612 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fe3e expref: -99 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.296249:0:18927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950605f06200/0x9df728c939b7a612 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe3e expref: 13 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.296260:0:18927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950605f06200/0x9df728c939b7a612 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe3e expref: 13 pid: 18927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.296280:0:18927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06200, rc 0) 00000100:00100000:0.0:1789050266.296356:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b83cae77-0a6f-4d94-80d9-6507de3f20fd+13:16764:x1875954691615488:12345-192.168.206.1@tcp:101:ll_cfg_requeue.0 Request processed in 205us (3706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050266.296363:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 109 00000100:00100000:3.0:1789050266.302419:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050266.304081:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691615616 00000100:00100000:1.0:1789050266.304096:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691615616 00000100:00100000:1.0:1789050266.304165:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 110 00000100:00100000:1.0:1789050266.304175:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+13:16764:x1875954691615616:12345-192.168.206.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789050266.304761:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b83cae77-0a6f-4d94-80d9-6507de3f20fd+13:16764:x1875954691615616:12345-192.168.206.1@tcp:501:ll_cfg_requeue.0 Request processed in 585us (2349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050266.304771:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 110 00000100:00100000:3.0:1789050266.310183:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050266.310517:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691615744 00000100:00100000:2.0:1789050266.310526:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691615744 00000100:00100000:2.0:1789050266.310582:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 111 00000100:00100000:2.0:1789050266.310592:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+13:16764:x1875954691615744:12345-192.168.206.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050266.310804:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+13:16764:x1875954691615744:12345-192.168.206.1@tcp:503:ll_cfg_requeue.0 Request processed in 212us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050266.310811:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 111 10000000:01000000:0.0:1789050266.572288:0:18930:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789050266.572296:0:18930:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9506059ea800 from 10 10000000:01000000:0.0:1789050266.572301:0:18930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789050266.572350:0:18930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950605f07e00/0x9df728c939b7a619 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.572362:0:18930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950605f07e00/0x9df728c939b7a619 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.572373:0:18930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950605f07e00/0x9df728c939b7a619 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050266.572397:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704183552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789050266.572474:0:18930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050266.572548:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606eb3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789050266.572693:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704183552 00000100:00100000:1.0:1789050266.572702:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704183552 00000100:00100000:1.0:1789050266.572756:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789050266.572766:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+16:18930:x1875954704183552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050266.572793:0:18925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050266.572806:0:18925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950605cf8800/0x9df728c939b7a620 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7a619 expref: -99 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.572829:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950605cf8800/0x9df728c939b7a620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7a619 expref: 17 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.572840:0:18925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950605cf8800/0x9df728c939b7a620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a619 expref: 17 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.572848:0:18925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605cf8800, rc 0) 00000100:00100000:1.0:1789050266.572895:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+17:18930:x1875954704183552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050266.572902:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789050266.573021:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704183552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789050266.573047:0:18930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950605f07e00/0x9df728c939b7a619 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a620 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.573057:0:18930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950605f07e00/0x9df728c939b7a619 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7a620 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050266.573112:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704183680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050266.573144:0:18930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050266.573168:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606eb3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789050266.573274:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704183680 00000100:00100000:2.0:1789050266.573279:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704183680 00000100:00100000:2.0:1789050266.573308:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789050266.573315:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+17:18930:x1875954704183680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050266.573547:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+17:18930:x1875954704183680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050266.573554:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789050266.574032:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704183680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050266.574075:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704183808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789050266.574113:0:18930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789050266.574142:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606eb3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789050266.574242:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704183808 00000100:00100000:2.0:1789050266.574247:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704183808 00000100:00100000:2.0:1789050266.574279:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789050266.574287:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950704161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+17:18930:x1875954704183808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050266.574445:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950704161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+17:18930:x1875954704183808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050266.574467:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789050266.574553:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704183808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789050266.575336:0:21060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789050266.575730:0:18930:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789050266.575755:0:18930:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789050266.575766:0:18930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950605f07e00/0x9df728c939b7a619 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a620 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.575777:0:18930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950605f07e00/0x9df728c939b7a619 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a620 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789050266.575787:0:18930:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789050266.575789:0:18930:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff950704c52800 from 10 10000000:01000000:1.0:1789050266.575792:0:18930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789050266.575824:0:18930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950605cf8e00/0x9df728c939b7a627 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.575831:0:18930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950605cf8e00/0x9df728c939b7a627 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.575854:0:18930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950605cf8e00/0x9df728c939b7a627 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050266.575873:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720825880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704183936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789050266.575932:0:18930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050266.575968:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606cd4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789050266.576056:0:18925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704183936 00000100:00100000:2.0:1789050266.576062:0:18925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704183936 00000100:00100000:2.0:1789050266.576100:0:18925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789050266.576107:0:18925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+17:18930:x1875954704183936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050266.576118:0:18925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050266.576128:0:18925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950701489600/0x9df728c939b7a62e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7a627 expref: -99 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.576146:0:18925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950701489600/0x9df728c939b7a62e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7a627 expref: 18 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.576155:0:18925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950701489600/0x9df728c939b7a62e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a627 expref: 18 pid: 18925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.576162:0:18925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950701489600, rc 0) 00000100:00100000:2.0:1789050266.576233:0:18925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7878f230-1e80-42fc-b48c-88e089c8a2b3+18:18930:x1875954704183936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050266.576240:0:18925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789050266.576799:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720825880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704183936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789050266.576816:0:18930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950605cf8e00/0x9df728c939b7a627 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a62e expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.576826:0:18930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950605cf8e00/0x9df728c939b7a627 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7a62e expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050266.576879:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c271f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704184064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050266.577020:0:18930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050266.577118:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073d20ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1789050266.577178:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704184064 00000100:00100000:0.0:1789050266.577184:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704184064 00000100:00100000:0.0:1789050266.577251:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789050266.577260:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+18:18930:x1875954704184064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050266.577510:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+18:18930:x1875954704184064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050266.577518:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789050266.577691:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c271f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704184064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789050266.577727:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c271f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704184192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789050266.577778:0:18930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050266.577805:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073d20ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1789050266.578991:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704184192 00000100:00100000:0.0:1789050266.579003:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704184192 00000100:00100000:0.0:1789050266.579093:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789050266.579102:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+18:18930:x1875954704184192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789050266.579309:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+18:18930:x1875954704184192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050266.579317:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789050266.579418:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c271f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704184192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789050266.586639:0:21061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789050266.586789:0:18930:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789050266.586807:0:18930:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789050266.586817:0:18930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950605cf8e00/0x9df728c939b7a627 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a62e expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.586828:0:18930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950605cf8e00/0x9df728c939b7a627 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a62e expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789050266.586838:0:18930:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789050266.586851:0:18930:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95072f422000 from 10 10000000:01000000:2.0:1789050266.586854:0:18930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789050266.586889:0:18930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b7a635 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.586896:0:18930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b7a635 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.586919:0:18930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b7a635 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050266.586943:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c57bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704184320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789050266.587002:0:18930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050266.598520:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704939240 going to sleep for 11 seconds 00000100:00100000:1.0:1789050266.602298:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704184320 00000100:00100000:1.0:1789050266.602313:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704184320 00000100:00100000:1.0:1789050266.602374:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789050266.602385:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+18:18930:x1875954704184320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789050266.602401:0:18926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050266.602420:0:18926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff950605cf9400/0x9df728c939b7a63c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9df728c939b7a635 expref: -99 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.602448:0:18926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff950605cf9400/0x9df728c939b7a63c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9df728c939b7a635 expref: 19 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.602459:0:18926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff950605cf9400/0x9df728c939b7a63c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9df728c939b7a635 expref: 19 pid: 18926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.602479:0:18926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605cf9400, rc 0) 00000100:00100000:1.0:1789050266.602552:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:18930:x1875954704184320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (15550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050266.602560:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789050266.603147:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c57bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704184320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789050266.603168:0:18930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b7a635 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a63c expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.603177:0:18930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b7a635 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9df728c939b7a63c expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050266.603260:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c57bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704184448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050266.603298:0:18930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050266.603325:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704939240 going to sleep for 11 seconds 00000100:00100000:0.0:1789050266.606250:0:18927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704184448 00000100:00100000:0.0:1789050266.606264:0:18927:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704184448 00000100:00100000:0.0:1789050266.606323:0:18927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789050266.606333:0:18927:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:18930:x1875954704184448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789050266.606637:0:18927:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:18930:x1875954704184448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (3337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050266.606652:0:18927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789050266.606788:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c57bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704184448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789050266.606834:0:18930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c57bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704184576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789050266.606876:0:18930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050266.606921:0:18930:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704939240 going to sleep for 11 seconds 00000100:00100000:1.0:1789050266.607064:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704184576 00000100:00100000:1.0:1789050266.607069:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704184576 00000100:00100000:1.0:1789050266.607092:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789050266.607098:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:18930:x1875954704184576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789050266.607279:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7878f230-1e80-42fc-b48c-88e089c8a2b3+19:18930:x1875954704184576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050266.607287:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789050266.607649:0:18930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c57bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7878f230-1e80-42fc-b48c-88e089c8a2b3:18930:1875954704184576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789050266.608508:0:21062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789050266.608800:0:18930:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789050266.608817:0:18930:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789050266.608827:0:18930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b7a635 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a63c expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.608839:0:18930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.101@tcp lock: ffff950701488c00/0x9df728c939b7a635 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9df728c939b7a63c expref: -99 pid: 18930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050266.669728:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050266.669836:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691615872 00000100:00100000:2.0:1789050266.669846:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691615872 00000100:00100000:2.0:1789050266.669919:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:2.0:1789050266.669931:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+6:17374:x1875954691615872:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050266.669951:0:18934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050266.669973:0:18934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701488400/0x9df728c939b7a643 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fe45 expref: -99 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.670039:0:18934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b7a64a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.670054:0:18934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b7a64a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.670068:0:18934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b7a64a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.670083:0:18934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b7a651 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.670090:0:18934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b7a651 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.670097:0:18934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b7a651 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789050266.670382:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789050266.670657:0:18934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b7a658 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.670675:0:18934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b7a658 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.670698:0:18934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b7a658 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050266.670726:0:18934:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789050266.670730:0:18934:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050266.670774:0:18934:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b7a658 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.670785:0:18934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b7a64a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.670792:0:18934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b7a64a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.670798:0:18934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b7a64a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.670804:0:18934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701489200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050266.670808:0:18934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b7a64a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.670816:0:18934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b7a64a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.670827:0:18934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950714b52900) 00010000:00010000:3.0:1789050266.670830:0:18934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050266.670835:0:18934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b7a64a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.670851:0:18934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701489200/0x9df728c939b7a64a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.670865:0:18934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b7a651 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.670871:0:18934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b7a651 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.670877:0:18934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b7a651 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.670882:0:18934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050266.670885:0:18934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b7a651 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.670891:0:18934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b7a651 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.670898:0:18934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff950702e31700) 00010000:00010000:3.0:1789050266.670901:0:18934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050266.670904:0:18934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b7a651 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.670910:0:18934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b7a651 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.670944:0:18934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701488400/0x9df728c939b7a643 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe45 expref: 8 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.670971:0:18934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331400/0x9df728c939b7a658 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe45 expref: 7 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.670978:0:18934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9507102a3600) 00010000:00010000:3.0:1789050266.670980:0:18934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050266.670983:0:18934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331400, rc 0) 00000100:00100000:3.0:1789050266.671151:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+7:17374:x1875954691615872:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 1221us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050266.671159:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:3.0:1789050266.677455:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050266.678124:0:20811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691616128 00000100:00100000:2.0:1789050266.678135:0:20811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691616128 00000100:00100000:2.0:1789050266.678246:0:20811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 16 00000100:00100000:2.0:1789050266.678257:0:20811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd1a549-5106-461c-9c28-9bc689851eed+7:17374:x1875954691616128:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789050266.678277:0:20811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050266.678297:0:20811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701488600/0x9df728c939b7a65f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fe4c expref: -99 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.678366:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a666 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.678379:0:20811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a666 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.678390:0:20811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a666 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.678405:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b7a66d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.678413:0:20811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b7a66d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.678420:0:20811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b7a66d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.678741:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488e00/0x9df728c939b7a674 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.678751:0:20811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701488e00/0x9df728c939b7a674 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.678758:0:20811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701488e00/0x9df728c939b7a674 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050266.678778:0:20811:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789050266.678939:0:20811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a666 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.678947:0:20811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a666 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.678953:0:20811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a666 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.678958:0:20811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701489c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050266.678962:0:20811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a666 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.678969:0:20811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a666 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.678980:0:20811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9507102a3600) 00010000:00010000:2.0:1789050266.678983:0:20811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050266.678988:0:20811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a666 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.678994:0:20811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a666 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.679006:0:20811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b7a66d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.679012:0:20811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b7a66d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.679027:0:20811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b7a66d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.679032:0:20811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701489000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050266.679035:0:20811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b7a66d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.679042:0:20811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b7a66d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.679050:0:20811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff950702e31700) 00010000:00010000:2.0:1789050266.679053:0:20811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050266.679056:0:20811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b7a66d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.679061:0:20811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b7a66d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.679553:0:20811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701488600/0x9df728c939b7a65f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe4c expref: 10 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.679569:0:20811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488e00/0x9df728c939b7a674 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe4c expref: 9 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.679577:0:20811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff950702e31a00) 00010000:00010000:2.0:1789050266.679579:0:20811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050266.679582:0:20811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950701488e00, rc 0) 00000100:00100000:2.0:1789050266.679649:0:20811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd1a549-5106-461c-9c28-9bc689851eed+9:17374:x1875954691616128:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 1393us (2200us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1789050266.679665:0:20811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 16 00000100:00100000:0.0:1789050266.688577:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050266.694445:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691616256 00000100:00100000:3.0:1789050266.694472:0:18932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691616256 00000100:00100000:3.0:1789050266.694538:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 17 00000100:00100000:3.0:1789050266.694549:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd1a549-5106-461c-9c28-9bc689851eed+9:17374:x1875954691616256:12345-192.168.206.1@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789050266.694893:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd1a549-5106-461c-9c28-9bc689851eed+9:17374:x1875954691616256:12345-192.168.206.1@tcp:59:lhsmtool_posix.0 Request processed in 345us (6323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050266.694901:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 17 00000100:00100000:0.0:1789050266.749059:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050266.749154:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691616384 00000100:00100000:1.0:1789050266.749165:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691616384 00000100:00100000:1.0:1789050266.749252:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 18 00000100:00100000:1.0:1789050266.749261:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd1a549-5106-461c-9c28-9bc689851eed+9:17380:x1875954691616384:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:1.0:1789050266.749279:0:18933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050266.749299:0:18933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8c00/0x9df728c939b7a682 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fe53 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749356:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8a00/0x9df728c939b7a689 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749368:0:18933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8a00/0x9df728c939b7a689 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749381:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8a00/0x9df728c939b7a689 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749396:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8000/0x9df728c939b7a690 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749403:0:18933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8000/0x9df728c939b7a690 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749409:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8000/0x9df728c939b7a690 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749609:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8a00/0x9df728c939b7a689 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749618:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8a00/0x9df728c939b7a689 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749624:0:18933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8a00/0x9df728c939b7a689 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749631:0:18933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605cf8a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050266.749635:0:18933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8a00/0x9df728c939b7a689 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749642:0:18933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8a00/0x9df728c939b7a689 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749655:0:18933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950714b52900) 00010000:00010000:1.0:1789050266.749658:0:18933:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050266.749663:0:18933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8a00/0x9df728c939b7a689 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749669:0:18933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8a00/0x9df728c939b7a689 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749694:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8000/0x9df728c939b7a690 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749701:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8000/0x9df728c939b7a690 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749707:0:18933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8000/0x9df728c939b7a690 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749717:0:18933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605cf8000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050266.749721:0:18933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8000/0x9df728c939b7a690 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749727:0:18933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8000/0x9df728c939b7a690 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749735:0:18933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9507091fc800) 00010000:00010000:1.0:1789050266.749737:0:18933:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050266.749740:0:18933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8000/0x9df728c939b7a690 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749746:0:18933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8000/0x9df728c939b7a690 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749776:0:18933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8c00/0x9df728c939b7a682 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe53 expref: 10 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749785:0:18933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950714b52900) 00010000:00010000:1.0:1789050266.749788:0:18933:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050266.749791:0:18933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8c00/0x9df728c939b7a682 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe53 expref: 10 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.749800:0:18933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605cf8c00, rc 0) 00000100:00100000:1.0:1789050266.749853:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd1a549-5106-461c-9c28-9bc689851eed+9:17380:x1875954691616384:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 593us (804us total) trans 0 rc 301/301 00000100:00100000:1.0:1789050266.749860:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 18 00000100:00100000:2.0:1789050266.756556:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050266.756826:0:18941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691616512 00000100:00100000:3.0:1789050266.756835:0:18941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691616512 00000100:00100000:3.0:1789050266.756996:0:18941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:3.0:1789050266.757007:0:18941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c57bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0fd1a549-5106-461c-9c28-9bc689851eed+9:17380:x1875954691616512:12345-192.168.206.1@tcp:700:lfs.0 00000100:00100000:3.0:1789050266.757116:0:18941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c57bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0fd1a549-5106-461c-9c28-9bc689851eed+9:17380:x1875954691616512:12345-192.168.206.1@tcp:700:lfs.0 Request processed in 111us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050266.757124:0:18941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:0.0:1789050266.760331:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050266.760418:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691616768 00000100:00100000:3.0:1789050266.760427:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691616768 00000100:00100000:3.0:1789050266.760492:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 19 00000100:00100000:3.0:1789050266.760502:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+9:17380:x1875954691616768:12345-192.168.206.1@tcp:36:lfs.0 00010000:00010000:3.0:1789050266.760547:0:18934:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050266.760570:0:18934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a5c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fdce expref: 9 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.760592:0:18934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950714b52900) 00010000:00010000:3.0:1789050266.760597:0:18934:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789050266.761031:0:18934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a697 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.761117:0:18934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a5fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe30 expref: 5 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.761127:0:18934:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a697 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.761160:0:18934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a5fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe30 expref: 5 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.761174:0:18934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a5fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe30 expref: 5 pid: 20811 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050266.761188:0:18934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c272d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18934:1875954704184704:192.168.206.1@tcp:104: 00000100:00100000:3.0:1789050266.761384:0:18934:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073d20e480 going to sleep for 11 seconds 00000100:00100000:3.0:1789050266.763533:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704184960:0@lo:400:kworker.0 00000100:00100000:2.0:1789050266.763579:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704185088:0@lo:400:kworker.0 00000100:00100000:3.0:1789050266.763604:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050266.763620:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704184832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789050266.763642:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050266.763661:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704184960 00000100:00100000:3.0:1789050266.763668:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704184960 00000100:00100000:3.0:1789050266.763724:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789050266.763733:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704184960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050266.763781:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875954704184960:12345-0@lo:400:kworker.0 Request processed in 49us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050266.763788:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789050266.763821:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1875954704184960:0@lo:400:kworker.0 00000100:00100000:3.0:1789050266.763848:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050266.763876:0:20809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704185088 00000100:00100000:3.0:1789050266.763879:0:20809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704185088 00000100:00100000:3.0:1789050266.763902:0:20809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789050266.763908:0:20809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704185088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050266.763942:0:20809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704185088:12345-0@lo:400:kworker.0 Request processed in 34us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050266.763948:0:20809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789050266.763974:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704185088:0@lo:400:kworker.0 00000100:00100000:0.0:1789050266.765588:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704185216:0@lo:400:kworker.0 00000100:00100000:0.0:1789050266.765640:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050266.765758:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704185472:0@lo:400:kworker.0 00000100:00100000:3.0:1789050266.765798:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050266.765825:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789050266.765832:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950736cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704185344:0@lo:400:kworker.0 00000100:00100000:3.0:1789050266.765858:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050266.765890:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704185216 00000100:00100000:3.0:1789050266.765897:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704185216 00000100:00100000:3.0:1789050266.765936:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704185472 00000100:00100000:3.0:1789050266.765947:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704185472 00000100:00100000:3.0:1789050266.765963:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704185344 00000100:00100000:3.0:1789050266.765964:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704185344 00000100:00100000:3.0:1789050266.765976:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789050266.765982:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704185216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050266.766027:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875954704185216:12345-0@lo:400:kworker.0 Request processed in 43us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050266.766034:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789050266.766050:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789050266.766057:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704185472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050266.766088:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875954704185472:12345-0@lo:400:kworker.0 Request processed in 32us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050266.766094:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789050266.766105:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789050266.766111:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704185344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789050266.766140:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875954704185344:12345-0@lo:400:kworker.0 Request processed in 29us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050266.766145:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789050266.766185:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1875954704185344:0@lo:400:kworker.0 00000100:00100000:3.0:1789050266.766223:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1875954704185472:0@lo:400:kworker.0 00000100:00100000:0.0:1789050266.766232:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950736cb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875954704185216:0@lo:400:kworker.0 00000100:00080000:1.0:1789050266.768169:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789050266.768190:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789050266.768194:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789050266.768344:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050266.768374:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691616896 00000100:00100000:1.0:1789050266.768383:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691616896 00010000:00010000:1.0:1789050266.768422:0:18917:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a5fd lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe30 expref: 6 pid: 20811 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050266.768454:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:1.0:1789050266.768475:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720825f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1940353c-2b2a-4224-bbac-3372d105601d+6:2348:x1875954691616896:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050266.768488:0:18917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050266.768495:0:18917:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a5fd lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe30 expref: 6 pid: 20811 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.768508:0:18917:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a5fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe30 expref: 6 pid: 20811 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.768531:0:18917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950714b52900) 00010000:00010000:1.0:1789050266.768536:0:18917:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a697 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.768546:0:18917:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a697 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.768552:0:18917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a697 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050266.768570:0:18917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050266.768613:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720825f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1940353c-2b2a-4224-bbac-3372d105601d+6:2348:x1875954691616896:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 141us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050266.768629:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00080000:1.0:1789050266.768647:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789050266.768953:0:18934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a5fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe30 expref: 5 pid: 20811 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050266.768976:0:18934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c272d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18934:1875954704184704:192.168.206.1@tcp:104: 00010000:00010000:3.0:1789050266.768995:0:18934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a697 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.769010:0:18934:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a697 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.769016:0:18934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a697 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.769035:0:18934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b7a69e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.769045:0:18934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b7a69e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.769057:0:18934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b7a69e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050266.771702:0:18934:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789050266.771719:0:18934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a697 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.771729:0:18934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a697 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.771736:0:18934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a697 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.771743:0:18934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050266.771747:0:18934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a697 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050266.772060:0:19618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704184832 00000100:00100000:2.0:1789050266.772068:0:19618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704184832 00010000:00010000:0.0:1789050266.772084:0:18934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a697 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.772103:0:18934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff950714b52900) 00010000:00010000:0.0:1789050266.772107:0:18934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050266.772112:0:18934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a697 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.772118:0:18934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330200/0x9df728c939b7a697 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789050266.772140:0:18934:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000a0292c94 reply state 00000000b7ea8d1c transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b7a69e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050266.772149:0:18934:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789050266.772163:0:19618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789050266.772175:0:19618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c57ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704184832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789050266.772239:0:19618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789050266.772264:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+10:17380:x1875954691616768:12345-192.168.206.1@tcp:36:lfs.0 Request processed in 11761us (11939us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1789050266.772273:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 19 00000100:00100000:2.0:1789050266.772301:0:19618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c57ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875954704184832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (8655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050266.772309:0:19618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1789050266.777533:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b7a69e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050266.777534:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1875954704184832:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789050266.777557:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b7a69e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.777566:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b7a69e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.777572:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330800 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050266.777577:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b7a69e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.777597:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b7a69e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.777613:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9507102a3300) 00010000:00010000:0.0:1789050266.777617:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050266.777622:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b7a69e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.777628:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330800/0x9df728c939b7a69e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050266.895425:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050266.895520:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691617024 00000100:00100000:3.0:1789050266.895531:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691617024 00000100:00100000:3.0:1789050266.895588:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 20 00000100:00100000:3.0:1789050266.895599:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd1a549-5106-461c-9c28-9bc689851eed+9:17388:x1875954691617024:12345-192.168.206.1@tcp:101:lctl.0 00010000:00010000:3.0:1789050266.895621:0:18933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050266.895641:0:18933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a6a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fe5a expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.895706:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331a00/0x9df728c939b7a6ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.895719:0:18933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331a00/0x9df728c939b7a6ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.895748:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331a00/0x9df728c939b7a6ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050266.895781:0:18933:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789050266.895785:0:18933:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050266.895819:0:18933:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950703331a00/0x9df728c939b7a6ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.895843:0:18933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a6a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe5a expref: 11 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.895861:0:18933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331a00/0x9df728c939b7a6ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe5a expref: 10 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.895869:0:18933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9507102a3400) 00010000:00010000:3.0:1789050266.895872:0:18933:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050266.895875:0:18933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331a00, rc 0) 00000100:00100000:3.0:1789050266.895930:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd1a549-5106-461c-9c28-9bc689851eed+10:17388:x1875954691617024:12345-192.168.206.1@tcp:101:lctl.0 Request processed in 332us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050266.895937:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 20 00000100:00100000:3.0:1789050266.929639:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050266.930137:0:20811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691617152 00000100:00100000:2.0:1789050266.930146:0:20811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691617152 00000100:00100000:2.0:1789050266.930496:0:20811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 21 00000100:00100000:2.0:1789050266.930508:0:20811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1940353c-2b2a-4224-bbac-3372d105601d+5:17389:x1875954691617152:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:2.0:1789050266.930527:0:20811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050266.930546:0:20811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a6b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fe61 expref: -99 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.930606:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488000/0x9df728c939b7a6ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.930619:0:20811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701488000/0x9df728c939b7a6ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.930649:0:20811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701488000/0x9df728c939b7a6ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050266.930684:0:20811:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789050266.930688:0:20811:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789050266.930709:0:20811:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950701488000/0x9df728c939b7a6ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.930734:0:20811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a6b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe61 expref: 7 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.930754:0:20811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488000/0x9df728c939b7a6ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe61 expref: 6 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.930762:0:20811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9507102a3400) 00010000:00010000:2.0:1789050266.930765:0:20811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789050266.930768:0:20811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950701488000, rc 0) 00000100:00100000:2.0:1789050266.930818:0:20811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1940353c-2b2a-4224-bbac-3372d105601d+6:17389:x1875954691617152:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 312us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050266.930825:0:20811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 21 00000100:00100000:1.0:1789050266.937993:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050266.938080:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691617280 00000100:00100000:0.0:1789050266.938091:0:18932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691617280 00000100:00100000:0.0:1789050266.938155:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 22 00000100:00100000:0.0:1789050266.938166:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1940353c-2b2a-4224-bbac-3372d105601d+6:17389:x1875954691617280:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:0.0:1789050266.938187:0:18932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050266.938256:0:18932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a6c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fe68 expref: -99 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938331:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b7a6c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938346:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b7a6c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938358:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b7a6c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938383:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938404:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938411:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938507:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7a6d6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938515:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7a6d6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938523:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7a6d6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050266.938551:0:18932:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789050266.938555:0:18932:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789050266.938571:0:18932:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7a6d6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938582:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b7a6c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938588:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b7a6c8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938594:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b7a6c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938599:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06800 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050266.938603:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b7a6c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938618:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b7a6c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938629:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9507102a3400) 00010000:00010000:0.0:1789050266.938632:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050266.938637:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b7a6c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938644:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b7a6c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938665:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938672:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938678:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938683:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050266.938686:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938692:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938699:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff950714b52900) 00010000:00010000:0.0:1789050266.938702:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050266.938705:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938720:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938770:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a6c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe68 expref: 8 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938787:0:18932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7a6d6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe68 expref: 7 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.938795:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff950714b52800) 00010000:00010000:0.0:1789050266.938797:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789050266.938800:0:18932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f07800, rc 0) 00000100:00100000:0.0:1789050266.938859:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1940353c-2b2a-4224-bbac-3372d105601d+7:17389:x1875954691617280:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 695us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050266.938866:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 22 00000100:00100000:1.0:1789050266.948591:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050266.948687:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691617536 00000100:00100000:0.0:1789050266.948697:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691617536 00000100:00100000:0.0:1789050266.948823:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 23 00000100:00100000:0.0:1789050266.948835:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1940353c-2b2a-4224-bbac-3372d105601d+7:17389:x1875954691617536:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:0.0:1789050266.948855:0:18934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050266.948874:0:18934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a6dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fe6f expref: -99 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050266.948956:0:18934:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789050266.949084:0:18934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a6dd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe6f expref: 9 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.949115:0:18934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9507102a3400) 00010000:00010000:0.0:1789050266.949118:0:18934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789050266.949124:0:18934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a6dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe6f expref: 9 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.949144:0:18934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06a00, rc 0) 00000100:00100000:0.0:1789050266.949368:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1940353c-2b2a-4224-bbac-3372d105601d+8:17389:x1875954691617536:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 535us (785us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1789050266.949505:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 23 00000100:00100000:2.0:1789050266.952132:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050266.952232:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691617792 00000100:00100000:0.0:1789050266.952241:0:18932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691617792 00000100:00100000:0.0:1789050266.952510:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 24 00000100:00100000:0.0:1789050266.952521:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1940353c-2b2a-4224-bbac-3372d105601d+8:17389:x1875954691617792:12345-192.168.206.1@tcp:36:lfs.0 00010000:00010000:0.0:1789050266.952564:0:18932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050266.952585:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7a6d6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe68 expref: 8 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.952607:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff950714b52800) 00010000:00010000:0.0:1789050266.952616:0:18932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050266.952636:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6eb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.952648:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6eb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.952657:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6eb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789050266.952869:0:18932:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000f04197cc reply state 00000000a02cbbb5 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6eb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050266.952879:0:18932:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789050266.952885:0:18932:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789050266.953007:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1940353c-2b2a-4224-bbac-3372d105601d+9:17389:x1875954691617792:12345-192.168.206.1@tcp:36:lfs.0 Request processed in 488us (883us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1789050266.953014:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 24 00010000:00010000:2.0:1789050266.956126:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6eb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.956143:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6eb lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.956151:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6eb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.956174:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050266.956178:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6eb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.956186:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6eb lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.956232:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff950714b52900) 00010000:00010000:2.0:1789050266.956236:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789050266.956241:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6eb lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050266.956248:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a6eb lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050266.956490:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050266.956712:0:18935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691618048 00000100:00100000:2.0:1789050266.956721:0:18935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691618048 00000100:00100000:2.0:1789050266.956781:0:18935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 2 00000100:00100000:2.0:1789050266.956791:0:18935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1940353c-2b2a-4224-bbac-3372d105601d+8:17389:x1875954691618048:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:2.0:1789050266.957050:0:18935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1940353c-2b2a-4224-bbac-3372d105601d+9:17389:x1875954691618048:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 259us (562us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1789050266.957059:0:18935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 2 00000100:00100000:1.0:1789050266.961885:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050266.961972:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691618304 00000100:00100000:0.0:1789050266.961981:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691618304 00000100:00100000:0.0:1789050266.962363:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 25 00000100:00100000:0.0:1789050266.962388:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1940353c-2b2a-4224-bbac-3372d105601d+9:17389:x1875954691618304:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:0.0:1789050266.962410:0:18934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050266.962428:0:18934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b7a6f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fe76 expref: -99 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962504:0:18934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a6f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962517:0:18934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a6f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962528:0:18934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a6f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962542:0:18934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a700 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962548:0:18934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962568:0:18934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050266.962667:0:18934:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789050266.962745:0:18934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a6f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962753:0:18934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a6f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962760:0:18934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a6f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962766:0:18934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050266.962770:0:18934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a6f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962777:0:18934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a6f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962788:0:18934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9507102a3400) 00010000:00010000:0.0:1789050266.962791:0:18934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050266.962795:0:18934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a6f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962802:0:18934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a6f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962818:0:18934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962835:0:18934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a700 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962841:0:18934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a700 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962845:0:18934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050266.962848:0:18934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a700 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962854:0:18934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a700 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962862:0:18934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff950714b52400) 00010000:00010000:0.0:1789050266.962865:0:18934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050266.962867:0:18934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a700 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962873:0:18934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a700 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962909:0:18934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b7a6f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe76 expref: 11 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962919:0:18934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9507102a3400) 00010000:00010000:0.0:1789050266.962921:0:18934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789050266.962924:0:18934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b7a6f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe76 expref: 11 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050266.962945:0:18934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06800, rc 0) 00000100:00100000:0.0:1789050266.963171:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1940353c-2b2a-4224-bbac-3372d105601d+10:17389:x1875954691618304:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 796us (1292us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1789050266.963178:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 25 00000100:00100000:0.0:1789050266.967453:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050266.967693:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691618432 00000100:00100000:3.0:1789050266.967703:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691618432 00000100:00100000:3.0:1789050266.967757:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 26 00000100:00100000:3.0:1789050266.967767:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1940353c-2b2a-4224-bbac-3372d105601d+10:17389:x1875954691618432:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:3.0:1789050266.967789:0:18933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050266.967810:0:18933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a70e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fe7d expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.968010:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a715 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.968024:0:18933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a715 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.968104:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a715 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050266.968131:0:18933:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789050266.968134:0:18933:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050266.968150:0:18933:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a715 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.968176:0:18933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a70e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe7d expref: 12 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.968194:0:18933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a715 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe7d expref: 11 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050266.968337:0:18933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9507102a3e00) 00010000:00010000:3.0:1789050266.968341:0:18933:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789050266.968345:0:18933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331c00, rc 0) 00000100:00100000:3.0:1789050266.968525:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1940353c-2b2a-4224-bbac-3372d105601d+11:17389:x1875954691618432:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 758us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050266.968534:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 26 00000100:00100000:1.0:1789050266.972006:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050266.972335:0:18935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691618560 00000100:00100000:2.0:1789050266.972344:0:18935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691618560 00000100:00100000:2.0:1789050266.972431:0:18935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 3 00000100:00100000:2.0:1789050266.972441:0:18935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1940353c-2b2a-4224-bbac-3372d105601d+11:17389:x1875954691618560:12345-192.168.206.1@tcp:37:lfs.0 00000100:00100000:2.0:1789050266.977668:0:18935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1940353c-2b2a-4224-bbac-3372d105601d+11:17389:x1875954691618560:12345-192.168.206.1@tcp:37:lfs.0 Request processed in 5219us (5663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050266.977690:0:18935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 3 00000100:00100000:0.0:1789050266.980706:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050266.980809:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691618816 00000100:00100000:1.0:1789050266.980819:0:18936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691618816 00000100:00100000:1.0:1789050266.980872:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:1.0:1789050266.980882:0:18936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604dd1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1940353c-2b2a-4224-bbac-3372d105601d+11:17389:x1875954691618816:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:1.0:1789050266.981154:0:18936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604dd1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1940353c-2b2a-4224-bbac-3372d105601d+12:17389:x1875954691618816:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 273us (456us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1789050266.981162:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:1.0:1789050267.068152:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050267.068290:0:20811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691618944 00000100:00100000:2.0:1789050267.068300:0:20811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691618944 00000100:00100000:2.0:1789050267.068361:0:20811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 27 00000100:00100000:2.0:1789050267.068372:0:20811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd1a549-5106-461c-9c28-9bc689851eed+10:17395:x1875954691618944:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:2.0:1789050267.068391:0:20811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789050267.068409:0:20811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a71c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fe84 expref: -99 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068479:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b7a723 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068494:0:20811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b7a723 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068506:0:20811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b7a723 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068521:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488400/0x9df728c939b7a72a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068526:0:20811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701488400/0x9df728c939b7a72a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068532:0:20811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701488400/0x9df728c939b7a72a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068618:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b7a731 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068651:0:20811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b7a731 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068659:0:20811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b7a731 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789050267.068687:0:20811:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789050267.068690:0:20811:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789050267.068725:0:20811:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b7a731 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068737:0:20811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b7a723 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068743:0:20811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b7a723 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068748:0:20811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b7a723 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068753:0:20811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701489000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050267.068758:0:20811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b7a723 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068764:0:20811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b7a723 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068776:0:20811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9507102a3400) 00010000:00010000:2.0:1789050267.068779:0:20811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050267.068784:0:20811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b7a723 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068799:0:20811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701489000/0x9df728c939b7a723 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068813:0:20811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488400/0x9df728c939b7a72a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068818:0:20811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950701488400/0x9df728c939b7a72a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068823:0:20811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950701488400/0x9df728c939b7a72a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068827:0:20811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050267.068830:0:20811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701488400/0x9df728c939b7a72a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068835:0:20811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701488400/0x9df728c939b7a72a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068843:0:20811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff950702e31700) 00010000:00010000:2.0:1789050267.068845:0:20811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789050267.068847:0:20811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950701488400/0x9df728c939b7a72a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068853:0:20811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701488400/0x9df728c939b7a72a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068880:0:20811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a71c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe84 expref: 12 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068902:0:20811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950701488a00/0x9df728c939b7a731 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe84 expref: 11 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050267.068909:0:20811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9507102a3e00) 00010000:00010000:2.0:1789050267.068912:0:20811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789050267.068915:0:20811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950701488a00, rc 0) 00000100:00100000:2.0:1789050267.068981:0:20811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd1a549-5106-461c-9c28-9bc689851eed+11:17395:x1875954691618944:12345-192.168.206.1@tcp:101:bash.0 Request processed in 610us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050267.068988:0:20811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 27 00000100:00100000:0.0:1789050267.072592:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050267.072906:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691619200 00000100:00100000:1.0:1789050267.072915:0:18932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691619200 00000100:00100000:1.0:1789050267.073017:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 28 00000100:00100000:1.0:1789050267.073028:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd1a549-5106-461c-9c28-9bc689851eed+11:17395:x1875954691619200:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:1.0:1789050267.073142:0:18932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789050267.073161:0:18932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf9600/0x9df728c939b7a738 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fe8b expref: -99 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050267.073575:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf9200/0x9df728c939b7a73f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050267.073608:0:18932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a715 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe7d expref: 11 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050267.073617:0:18932:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf9200/0x9df728c939b7a73f lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050267.073721:0:18932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a715 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe7d expref: 11 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050267.073735:0:18932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a715 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe7d expref: 11 pid: 18933 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050267.073747:0:18932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18932:1875954704185600:192.168.206.1@tcp:104: 00000100:00100000:1.0:1789050267.073956:0:18932:0:(client.c:2716:ptlrpc_set_wait()) set ffff950703419840 going to sleep for 11 seconds 00000100:00100000:0.0:1789050267.077830:0:18932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950720824000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18932:1875954704185600:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050267.077860:0:18932:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf9200/0x9df728c939b7a73f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050267.081386:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050267.082053:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691619328 00000100:00100000:1.0:1789050267.082063:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691619328 00010000:00010000:1.0:1789050267.082106:0:18919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a715 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe7d expref: 12 pid: 18933 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050267.082151:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:1.0:1789050267.082162:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1940353c-2b2a-4224-bbac-3372d105601d+12:2348:x1875954691619328:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050267.082177:0:18919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050267.082184:0:18919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a715 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe7d expref: 12 pid: 18933 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050267.082229:0:18919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a715 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe7d expref: 12 pid: 18933 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050267.082266:0:18919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a715 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe7d expref: 12 pid: 18933 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050267.082284:0:18919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9507102a3e00) 00010000:00010000:1.0:1789050267.082289:0:18919:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf9200/0x9df728c939b7a73f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050267.082298:0:18919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf9200/0x9df728c939b7a73f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050267.082306:0:18919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf9200/0x9df728c939b7a73f lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050267.082513:0:18919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050267.082574:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1940353c-2b2a-4224-bbac-3372d105601d+11:2348:x1875954691619328:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 412us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050267.082583:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 10 00010000:00010000:0.0:1789050267.083612:0:18932:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf9200/0x9df728c939b7a73f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.083624:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf9200/0x9df728c939b7a73f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.083715:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a746 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.083727:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a746 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.083737:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a746 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.088543:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a74d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.088567:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a74d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.088579:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a74d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050267.088591:0:18932:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789050267.088618:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf9200/0x9df728c939b7a73f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.088624:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf9200/0x9df728c939b7a73f lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.090156:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf9200/0x9df728c939b7a73f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.090165:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605cf9200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050267.090169:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf9200/0x9df728c939b7a73f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.090179:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf9200/0x9df728c939b7a73f lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.090196:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9507102a3e00) 00010000:00010000:0.0:1789050267.090212:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050267.090218:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf9200/0x9df728c939b7a73f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.090225:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf9200/0x9df728c939b7a73f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789050267.090245:0:18932:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000be46fcc5 reply state 00000000801cc8bb transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a746 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050267.090270:0:18932:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789050267.090317:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf9600/0x9df728c939b7a738 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe8b expref: 14 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.090718:0:18932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a74d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe8b expref: 13 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.090725:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff950714b52800) 00010000:00010000:0.0:1789050267.090727:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789050267.090730:0:18932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06a00, rc 0) 00000100:00100000:0.0:1789050267.090886:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd1a549-5106-461c-9c28-9bc689851eed+14:17395:x1875954691619200:12345-192.168.206.1@tcp:101:bash.0 Request processed in 17859us (18301us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1789050267.090895:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 28 00010000:00010000:1.0:1789050267.093434:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a746 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050267.093455:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a746 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050267.093472:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a746 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050267.093478:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:1.0:1789050267.093483:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a746 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050267.093509:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a746 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050267.093526:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff950714b52400) 00010000:00010000:1.0:1789050267.093529:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789050267.093534:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a746 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050267.093541:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a746 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050267.121163:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050267.121751:0:20811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691619456 00000100:00100000:3.0:1789050267.121761:0:20811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691619456 00000100:00100000:3.0:1789050267.121835:0:20811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 29 00000100:00100000:3.0:1789050267.121845:0:20811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd1a549-5106-461c-9c28-9bc689851eed+13:17395:x1875954691619456:12345-192.168.206.1@tcp:101:bash.0 00010000:00010000:3.0:1789050267.121869:0:20811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050267.121888:0:20811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a75b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fe92 expref: -99 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.121953:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a762 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.121967:0:20811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a762 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.121978:0:20811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a762 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050267.122015:0:20811:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789050267.122019:0:20811:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789050267.122657:0:20811:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a762 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.122670:0:20811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a762 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.122695:0:20811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a75b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe92 expref: 15 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.122713:0:20811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a762 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe92 expref: 14 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.122722:0:20811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff950714b52800) 00010000:00010000:3.0:1789050267.122733:0:20811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789050267.122737:0:20811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330c00, rc 0) 00000100:00100000:3.0:1789050267.122861:0:20811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd1a549-5106-461c-9c28-9bc689851eed+14:17395:x1875954691619456:12345-192.168.206.1@tcp:101:bash.0 Request processed in 1016us (1706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050267.122869:0:20811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 29 00000100:00100000:0.0:1789050267.134671:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050267.134770:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691619712 00000100:00100000:1.0:1789050267.134779:0:18936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691619712 00000100:00100000:1.0:1789050267.134836:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00100000:1.0:1789050267.134847:0:18936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0fd1a549-5106-461c-9c28-9bc689851eed+14:17395:x1875954691619712:12345-192.168.206.1@tcp:35:bash.0 00000001:00080000:1.0:1789050267.135132:0:18936:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901897 00000100:00100000:1.0:1789050267.135300:0:18936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0fd1a549-5106-461c-9c28-9bc689851eed+16:17395:x1875954691619712:12345-192.168.206.1@tcp:35:bash.0 Request processed in 454us (637us total) trans 12884901898 rc 0/0 00000100:00100000:1.0:1789050267.135309:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 5 00000020:00080000:1.0:1789050267.135323:0:18936:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789050267.212121:0:20603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789050267.254295:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050267.256825:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691619968 00000100:00100000:3.0:1789050267.256840:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691619968 00000100:00100000:3.0:1789050267.256910:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 30 00000100:00100000:3.0:1789050267.256921:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd1a549-5106-461c-9c28-9bc689851eed+16:17405:x1875954691619968:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:3.0:1789050267.256945:0:18933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050267.256965:0:18933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a769 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fe99 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050267.257052:0:18933:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789050267.257160:0:18933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a769 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe99 expref: 18 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.257175:0:18933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9507102a3400) 00010000:00010000:3.0:1789050267.257178:0:18933:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789050267.257184:0:18933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a769 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe99 expref: 18 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.257230:0:18933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330400, rc 0) 00000100:00100000:3.0:1789050267.257316:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd1a549-5106-461c-9c28-9bc689851eed+17:17405:x1875954691619968:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 397us (3030us total) trans 12884901899 rc 301/301 00000100:00100000:3.0:1789050267.257324:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 30 00000100:00100000:3.0:1789050267.267088:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050267.267766:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691620224 00000100:00100000:1.0:1789050267.267775:0:18936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691620224 00000100:00100000:1.0:1789050267.267833:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:1.0:1789050267.267842:0:18936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0fd1a549-5106-461c-9c28-9bc689851eed+17:17405:x1875954691620224:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:1.0:1789050267.268256:0:18936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0fd1a549-5106-461c-9c28-9bc689851eed+18:17405:x1875954691620224:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 412us (1174us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1789050267.268276:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:1.0:1789050267.345287:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050267.345375:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691620480 00000100:00100000:0.0:1789050267.345385:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691620480 00000100:00100000:0.0:1789050267.345442:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 31 00000100:00100000:0.0:1789050267.345453:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+18:17408:x1875954691620480:12345-192.168.206.1@tcp:101:lfs.0 00010000:00010000:0.0:1789050267.345485:0:18934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050267.345503:0:18934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7a777 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fea0 expref: -99 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.345594:0:18934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a77e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.345609:0:18934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a77e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.345634:0:18934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a77e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050267.345648:0:18934:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789050267.345767:0:18934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7a777 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fea0 expref: 21 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.345790:0:18934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a77e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fea0 expref: 20 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.345800:0:18934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff950714b52800) 00010000:00010000:0.0:1789050267.345803:0:18934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050267.345806:0:18934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06e00, rc 0) 00000100:00100000:0.0:1789050267.345869:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+20:17408:x1875954691620480:12345-192.168.206.1@tcp:101:lfs.0 Request processed in 417us (590us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1789050267.345877:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 31 00000100:00100000:0.0:1789050267.358077:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050267.358220:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050267.359008:0:18918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691620736 00000100:00100000:1.0:1789050267.359021:0:18918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691620736 00000100:00100000:1.0:1789050267.359097:0:18918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:1.0:1789050267.359107:0:18918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0fd1a549-5106-461c-9c28-9bc689851eed+20:2348:x1875954691620736:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789050267.359124:0:18918:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789050267.359147:0:18918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a77e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fea0 expref: 20 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050267.359173:0:18918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff950714b52800) 00010000:00010000:1.0:1789050267.359178:0:18918:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789050267.359267:0:18918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0fd1a549-5106-461c-9c28-9bc689851eed+19:2348:x1875954691620736:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 161us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050267.359275:0:18918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:3.0:1789050267.366293:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691620608 00000100:00100000:3.0:1789050267.366307:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691620608 00000100:00100000:3.0:1789050267.366412:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 32 00000100:00100000:3.0:1789050267.366424:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950736cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd1a549-5106-461c-9c28-9bc689851eed+19:17408:x1875954691620608:12345-192.168.206.1@tcp:54:lfs.0 00010000:00010000:3.0:1789050267.366495:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a78c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.366511:0:18933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a78c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.366522:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a78c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.366547:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a78c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.366554:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a78c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.366560:0:18933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a78c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.366565:0:18933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050267.366570:0:18933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a78c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.366578:0:18933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a78c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.366589:0:18933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff950714b52800) 00010000:00010000:3.0:1789050267.366592:0:18933:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789050267.366611:0:18933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a78c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.366618:0:18933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a78c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050267.366706:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950736cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd1a549-5106-461c-9c28-9bc689851eed+19:17408:x1875954691620608:12345-192.168.206.1@tcp:54:lfs.0 Request processed in 284us (8637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050267.366714:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 32 00000100:00100000:1.0:1789050267.376519:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050267.378295:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691620992 00000100:00100000:3.0:1789050267.378309:0:18936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691620992 00000100:00100000:3.0:1789050267.378367:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:3.0:1789050267.378378:0:18936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950720824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0fd1a549-5106-461c-9c28-9bc689851eed+19:17408:x1875954691620992:12345-192.168.206.1@tcp:35:lfs.0 00000100:00100000:3.0:1789050267.378665:0:18936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950720824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0fd1a549-5106-461c-9c28-9bc689851eed+20:17408:x1875954691620992:12345-192.168.206.1@tcp:35:lfs.0 Request processed in 287us (2153us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1789050267.378674:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 7 00000040:00080000:3.0:1789050267.467807:0:18964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789050267.676044:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050267.676153:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691621248 00000100:00100000:0.0:1789050267.676162:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691621248 00000100:00100000:0.0:1789050267.676251:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 33 00000100:00100000:0.0:1789050267.676262:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+20:17439:x1875954691621248:12345-192.168.206.1@tcp:101:cat.0 00010000:00010000:0.0:1789050267.676284:0:18934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050267.676303:0:18934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7a793 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fea7 expref: -99 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.676391:0:18934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7a79a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.676416:0:18934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7a79a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.676427:0:18934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7a79a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050267.676439:0:18934:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789050267.676812:0:18934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7a793 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fea7 expref: 23 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.676837:0:18934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7a79a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fea7 expref: 22 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.676846:0:18934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff950714b52800) 00010000:00010000:0.0:1789050267.676849:0:18934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050267.676853:0:18934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f07200, rc 0) 00000100:00100000:0.0:1789050267.677047:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+22:17439:x1875954691621248:12345-192.168.206.1@tcp:101:cat.0 Request processed in 785us (1010us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1789050267.677054:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 33 00000100:00100000:1.0:1789050267.687721:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050267.687868:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691621376 00000100:00100000:0.0:1789050267.687879:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691621376 00000100:00100000:0.0:1789050267.687943:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 1 00000100:00100000:0.0:1789050267.687953:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c259880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0fd1a549-5106-461c-9c28-9bc689851eed+22:2347:x1875954691621376:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789050267.687967:0:18919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050267.687991:0:18919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7a79a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fea7 expref: 22 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.688028:0:18919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff950714b52800) 00010000:00010000:0.0:1789050267.688033:0:18919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789050267.688091:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c259880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0fd1a549-5106-461c-9c28-9bc689851eed+21:2347:x1875954691621376:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 140us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050267.688099:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 1 00000100:00100000:1.0:1789050267.693648:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050267.693796:0:18935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691621632 00000100:00100000:2.0:1789050267.693805:0:18935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691621632 00000100:00100000:2.0:1789050267.693858:0:18935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 8 00000100:00100000:2.0:1789050267.693879:0:18935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0fd1a549-5106-461c-9c28-9bc689851eed+21:17439:x1875954691621632:12345-192.168.206.1@tcp:35:cat.0 00000001:00080000:2.0:1789050267.694149:0:18935:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901904 00000100:00100000:2.0:1789050267.694286:0:18935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0fd1a549-5106-461c-9c28-9bc689851eed+23:17439:x1875954691621632:12345-192.168.206.1@tcp:35:cat.0 Request processed in 418us (646us total) trans 12884901905 rc 0/0 00000100:00100000:2.0:1789050267.694295:0:18935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 8 00000020:00080000:2.0:1789050267.694299:0:18935:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789050267.772935:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050267.773052:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691621888 00000100:00100000:0.0:1789050267.773061:0:18932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691621888 00000100:00100000:0.0:1789050267.773116:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 34 00000100:00100000:0.0:1789050267.773126:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd1a549-5106-461c-9c28-9bc689851eed+23:17445:x1875954691621888:12345-192.168.206.1@tcp:101:dd.0 00010000:00010000:0.0:1789050267.773149:0:18932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050267.773168:0:18932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7a7a8 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34feae expref: -99 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.773293:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7a7af lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.773308:0:18932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a74d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe8b expref: 24 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.773317:0:18932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a762 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe92 expref: 24 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.773326:0:18932:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7a7af lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.773357:0:18932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a762 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe92 expref: 24 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.773387:0:18932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a762 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe92 expref: 24 pid: 20811 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050267.773402:0:18932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18932:1875954704185728:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050267.773493:0:18932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a74d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe8b expref: 24 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.773504:0:18932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a74d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe8b expref: 24 pid: 18932 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050267.773512:0:18932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c517100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18932:1875954704185856:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050267.773536:0:18932:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606eb3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789050267.776275:0:18932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18932:1875954704185728:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050267.776289:0:18932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c517100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18932:1875954704185856:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050267.776314:0:18932:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7a7af lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050267.781957:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050267.782004:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050267.782181:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691622016 00000100:00100000:3.0:1789050267.782191:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691622016 00010000:00010000:3.0:1789050267.782253:0:18917:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a762 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe92 expref: 25 pid: 20811 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050267.782292:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691622144 00000100:00100000:3.0:1789050267.782296:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691622144 00010000:00010000:3.0:1789050267.782310:0:18917:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a74d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe8b expref: 26 pid: 18932 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050267.782326:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:3.0:1789050267.782334:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9507101b3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0fd1a549-5106-461c-9c28-9bc689851eed+26:2348:x1875954691622016:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050267.782362:0:18917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050267.782369:0:18917:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a762 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe92 expref: 26 pid: 20811 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.782381:0:18917:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a762 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe92 expref: 26 pid: 20811 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.782402:0:18917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a762 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe92 expref: 26 pid: 20811 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.782419:0:18917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff950714b52800) 00010000:00010000:3.0:1789050267.782425:0:18917:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7a7af lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.782433:0:18917:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7a7af lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.782439:0:18917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050267.782503:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9507101b3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0fd1a549-5106-461c-9c28-9bc689851eed+25:2348:x1875954691622016:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 169us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050267.782511:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:3.0:1789050267.782553:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 12 00000100:00100000:3.0:1789050267.782570:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c57aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0fd1a549-5106-461c-9c28-9bc689851eed+24:2348:x1875954691622144:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050267.782578:0:18917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050267.782583:0:18917:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a74d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe8b expref: 24 pid: 18932 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.782615:0:18917:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a74d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe8b expref: 24 pid: 18932 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.782628:0:18917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a74d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fe8b expref: 24 pid: 18932 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.782645:0:18917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff950714b52800) 00010000:00010000:3.0:1789050267.782649:0:18917:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7a7af lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.782657:0:18917:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7a7af lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.782665:0:18917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7a7af lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.782861:0:18917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050267.782884:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c57aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0fd1a549-5106-461c-9c28-9bc689851eed+23:2348:x1875954691622144:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 324us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050267.782891:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 12 00010000:00010000:3.0:1789050267.782915:0:18932:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7a7af lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.782923:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7a7af lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050267.782940:0:18932:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789050267.783295:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7a7a8 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34feae expref: 24 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.783328:0:18932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07a00/0x9df728c939b7a7af lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34feae expref: 23 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.783335:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff950714b52800) 00010000:00010000:3.0:1789050267.783338:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789050267.783340:0:18932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f07a00, rc 0) 00000100:00100000:3.0:1789050267.783365:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd1a549-5106-461c-9c28-9bc689851eed+23:17445:x1875954691621888:12345-192.168.206.1@tcp:101:dd.0 Request processed in 10241us (10439us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1789050267.783372:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 34 00000100:00100000:1.0:1789050267.786419:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050267.786954:0:20811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691622400 00000100:00100000:3.0:1789050267.786964:0:20811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691622400 00000100:00100000:3.0:1789050267.787079:0:20811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 35 00000100:00100000:3.0:1789050267.787089:0:20811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd1a549-5106-461c-9c28-9bc689851eed+23:17445:x1875954691622400:12345-192.168.206.1@tcp:36:dd.0 00010000:00010000:3.0:1789050267.787363:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a7bd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.787379:0:20811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a7bd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.787389:0:20811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a7bd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789050267.787438:0:20811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901907 00000004:00010000:3.0:1789050267.787484:0:20811:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000919ab70d reply state 00000000c640d2bd transno 12884901908 ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a7bd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050267.787493:0:20811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789050267.787598:0:20811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd1a549-5106-461c-9c28-9bc689851eed+26:17445:x1875954691622400:12345-192.168.206.1@tcp:36:dd.0 Request processed in 510us (1186us total) trans 12884901908 rc 0/0 00000100:00100000:3.0:1789050267.787614:0:20811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 35 00000020:00080000:3.0:1789050267.787619:0:20811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789050267.795368:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a7bd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.795384:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a7bd lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.795391:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a7bd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.795398:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050267.795402:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a7bd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.795408:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a7bd lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.795423:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff950714b52800) 00010000:00010000:3.0:1789050267.795426:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050267.795430:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a7bd lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.795436:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a7bd lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050267.799765:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050267.799841:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691622528 00000100:00100000:3.0:1789050267.799850:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691622528 00000100:00100000:3.0:1789050267.799917:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 36 00000100:00100000:3.0:1789050267.799928:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd1a549-5106-461c-9c28-9bc689851eed+25:17445:x1875954691622528:12345-192.168.206.1@tcp:101:dd.0 00010000:00010000:3.0:1789050267.799965:0:18933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050267.799985:0:18933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a7c4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34feb5 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.800060:0:18933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a7c4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34feb5 expref: 26 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.800074:0:18933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a7c4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34feb5 expref: 26 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.800091:0:18933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff950714b52800) 00010000:00010000:3.0:1789050267.800094:0:18933:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050267.800098:0:18933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330c00, rc 0) 00000100:00100000:3.0:1789050267.800156:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd1a549-5106-461c-9c28-9bc689851eed+26:17445:x1875954691622528:12345-192.168.206.1@tcp:101:dd.0 Request processed in 230us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050267.800163:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 36 00000100:00100000:2.0:1789050267.822814:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050267.822901:0:18917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691622784 00000100:00100000:3.0:1789050267.822910:0:18917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691622784 00000100:00100000:3.0:1789050267.822974:0:18917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 2 00000100:00100000:3.0:1789050267.822985:0:18917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c578700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0fd1a549-5106-461c-9c28-9bc689851eed+26:17445:x1875954691622784:12345-192.168.206.1@tcp:103:dd.0 00010000:00010000:3.0:1789050267.823004:0:18917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050267.823300:0:18917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a7c4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34feb5 expref: 26 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.823322:0:18917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff950714b52800) 00010000:00010000:3.0:1789050267.823327:0:18917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050267.823491:0:18917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c578700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0fd1a549-5106-461c-9c28-9bc689851eed+25:17445:x1875954691622784:12345-192.168.206.1@tcp:103:dd.0 Request processed in 505us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050267.823515:0:18917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 2 00000100:00100000:2.0:1789050267.825386:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050267.825950:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691622912 00000100:00100000:0.0:1789050267.825959:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691622912 00000100:00100000:0.0:1789050267.826185:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 37 00000100:00100000:0.0:1789050267.826196:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c57a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+25:17445:x1875954691622912:12345-192.168.206.1@tcp:58:dd.0 00010000:00010000:0.0:1789050267.826329:0:18934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7a7cb lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.826344:0:18934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7a7cb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050267.826361:0:18934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7a7cb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789050267.827393:0:18934:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789050267.827561:0:18934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1789050267.827636:0:18934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1789050267.830981:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c57a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+25:17445:x1875954691622912:12345-192.168.206.1@tcp:58:dd.0 Request processed in 4777us (5592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050267.830996:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 37 00000100:00100000:1.0:1789050267.833607:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050267.833688:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691623040 00000100:00100000:3.0:1789050267.833712:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691623040 00000100:00100000:3.0:1789050267.833858:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 38 00000100:00100000:3.0:1789050267.833869:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd1a549-5106-461c-9c28-9bc689851eed+25:17445:x1875954691623040:12345-192.168.206.1@tcp:101:dd.0 00010000:00010000:3.0:1789050267.833887:0:18933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050267.833907:0:18933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a7d2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34febc expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.833963:0:18933:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7a7cb lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.833974:0:18933:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a7d2 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34febc expref: 26 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.833993:0:18933:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7a7cb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.834004:0:18933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a7d2 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34febc expref: 26 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.834016:0:18933:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff950714b52800) 00010000:00010000:3.0:1789050267.834019:0:18933:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050267.834040:0:18933:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a7d2 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34febc expref: 26 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050267.834048:0:18933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330400, rc 0) 00000100:00100000:3.0:1789050267.834147:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd1a549-5106-461c-9c28-9bc689851eed+26:17445:x1875954691623040:12345-192.168.206.1@tcp:101:dd.0 Request processed in 280us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050267.834154:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 38 00010000:00010000:0.0:1789050268.235508:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789050268.491616:0:18964:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789050268.491630:0:18964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789050268.491673:0:18964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1789050268.491681:0:18964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1789050268.491850:0:18964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cd6e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18964:1875954704185984:192.168.206.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789050268.491988:0:18964:0:(client.c:2716:ptlrpc_set_wait()) set ffff95073d20eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789050268.500840:0:18964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cd6e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18964:1875954704185984:192.168.206.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789050268.503520:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050268.504486:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691623168 00000100:00100000:3.0:1789050268.504500:0:18943:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691623168 00000100:00100000:3.0:1789050268.504638:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:3.0:1789050268.504652:0:18943:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0fd1a549-5106-461c-9c28-9bc689851eed+26:17446:x1875954691623168:12345-192.168.206.1@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789050268.504778:0:18943:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0fd1a549-5106-461c-9c28-9bc689851eed+26:17446:x1875954691623168:12345-192.168.206.1@tcp:900:lhsmtool_posix.0 Request processed in 128us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050268.504786:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:2.0:1789050268.507420:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050268.507522:0:20811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691623296 00000100:00100000:3.0:1789050268.507535:0:20811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691623296 00000100:00100000:3.0:1789050268.507608:0:20811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 39 00000100:00100000:3.0:1789050268.507619:0:20811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c57b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd1a549-5106-461c-9c28-9bc689851eed+26:17446:x1875954691623296:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789050268.507655:0:20811:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789050268.507800:0:20811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c57b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd1a549-5106-461c-9c28-9bc689851eed+26:17446:x1875954691623296:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 Request processed in 183us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050268.507809:0:20811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 39 00000100:00100000:2.0:1789050268.513712:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00080000:1.0:1789050268.513867:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050268.516993:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691623424 00000100:00100000:0.0:1789050268.517008:0:18932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691623424 00000100:00100000:0.0:1789050268.517144:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 40 00000100:00100000:0.0:1789050268.517156:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c57b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd1a549-5106-461c-9c28-9bc689851eed+26:17446:x1875954691623424:12345-192.168.206.1@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789050268.517263:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a7d9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517287:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a7d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517298:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a7d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517315:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a7e0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517322:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517329:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517351:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a7e7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517384:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a7e7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517396:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a7e7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050268.517433:0:18932:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789050268.517437:0:18932:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789050268.517466:0:18932:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a7e7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517477:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a7d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517484:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a7d9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517491:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a7d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517497:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050268.517501:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a7d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517509:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a7d9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517521:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff950702e31a00) 00010000:00010000:0.0:1789050268.517524:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050268.517529:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a7d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517545:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a7d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517566:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517572:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a7e0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517586:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517591:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06e00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050268.517594:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517599:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a7e0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517606:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff950714b52d00) 00010000:00010000:0.0:1789050268.517609:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050268.517615:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a7e0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517621:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a7e0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517634:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a7e7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517639:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a7e7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517649:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a7e7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517654:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050268.517657:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a7e7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517663:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a7e7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517671:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff950714b52800) 00010000:00010000:0.0:1789050268.517673:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050268.517676:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a7e7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.517681:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a7e7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050268.517762:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c57b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd1a549-5106-461c-9c28-9bc689851eed+26:17446:x1875954691623424:12345-192.168.206.1@tcp:34:lhsmtool_posix.0 Request processed in 608us (4063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050268.517770:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 40 00000100:00100000:2.0:1789050268.522698:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050268.523170:0:20811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691623680 00000100:00100000:3.0:1789050268.523183:0:20811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691623680 00000100:00100000:3.0:1789050268.523283:0:20811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 41 00000100:00100000:3.0:1789050268.523295:0:20811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c57a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd1a549-5106-461c-9c28-9bc689851eed+26:17446:x1875954691623680:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050268.523340:0:20811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050268.523367:0:20811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a7ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fec3 expref: -99 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.523512:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a7f5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.523530:0:20811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a7f5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.523544:0:20811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a7f5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789050268.523558:0:20811:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789050268.523679:0:20811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a7f5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.523687:0:20811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a7f5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.523695:0:20811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a7f5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.523701:0:20811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050268.523706:0:20811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a7f5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.523715:0:20811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a7f5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.523728:0:20811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff950714b52800) 00010000:00010000:3.0:1789050268.523737:0:20811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789050268.523744:0:20811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a7f5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.523750:0:20811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703331c00/0x9df728c939b7a7f5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.523803:0:20811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a7ee lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fec3 expref: 28 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.523815:0:20811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff950702e31a00) 00010000:00010000:3.0:1789050268.523817:0:20811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789050268.523821:0:20811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a7ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fec3 expref: 28 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.523832:0:20811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330c00, rc 0) 00000100:00100000:3.0:1789050268.524090:0:20811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c57a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd1a549-5106-461c-9c28-9bc689851eed+27:17446:x1875954691623680:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 795us (1404us total) trans 12884901909 rc 301/301 00000100:00100000:3.0:1789050268.524102:0:20811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 41 00000100:00100000:2.0:1789050268.528092:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050268.528165:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691623808 00000100:00100000:3.0:1789050268.528180:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691623808 00000100:00100000:3.0:1789050268.528288:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 42 00000100:00100000:3.0:1789050268.528300:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd1a549-5106-461c-9c28-9bc689851eed+27:17446:x1875954691623808:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789050268.528334:0:18933:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789050268.528678:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd1a549-5106-461c-9c28-9bc689851eed+27:17446:x1875954691623808:12345-192.168.206.1@tcp:53:lhsmtool_posix.0 Request processed in 379us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050268.530521:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 42 00000100:00100000:2.0:1789050268.532815:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050268.532906:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691624064 00000100:00100000:0.0:1789050268.532915:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691624064 00000100:00100000:0.0:1789050268.532964:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 43 00000100:00100000:0.0:1789050268.532974:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c57b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+27:17446:x1875954691624064:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050268.532993:0:18934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050268.533013:0:18934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a803 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34feca expref: -99 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789050268.533672:0:18934:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =59 00000004:00080000:0.0:1789050268.533678:0:18934:0:(osp_object.c:1650:osp_create()) Writing gap [0x240000400:0x7:0x0]+59 in llog 00000004:00080000:0.0:1789050268.533727:0:18934:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42:0x0], index 0: 0 00010000:00010000:0.0:1789050268.533996:0:18934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a80a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.534010:0:18934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a80a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.534021:0:18934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a80a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.534079:0:18934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a803 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34feca expref: 30 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.534100:0:18934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a80a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34feca expref: 29 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.534109:0:18934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff950714b52d00) 00010000:00010000:0.0:1789050268.534112:0:18934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789050268.534115:0:18934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06e00, rc 0) 00000100:00100000:0.0:1789050268.534178:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c57b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+29:17446:x1875954691624064:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 1205us (1370us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1789050268.534186:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 43 00000100:00100000:3.0:1789050268.537934:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050268.538036:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691624320 00000100:00100000:0.0:1789050268.538046:0:18932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691624320 00000100:00100000:0.0:1789050268.538144:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 44 00000100:00100000:0.0:1789050268.538154:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd1a549-5106-461c-9c28-9bc689851eed+29:17446:x1875954691624320:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789050268.538381:0:18932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789050268.538403:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a80a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34feca expref: 29 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.538421:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff950714b52d00) 00010000:00010000:0.0:1789050268.538428:0:18932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789050268.538445:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a818 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.538471:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a818 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.538480:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a818 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.538493:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a81f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x27e1d104 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.538501:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a81f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x27e1d104 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.538507:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a81f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x27e1d104 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.538556:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a818 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.538561:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a818 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.538565:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a818 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.538574:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07400 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050268.538577:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a818 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.538582:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a818 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.538588:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9507102a3e00) 00010000:00010000:0.0:1789050268.538589:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050268.538592:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a818 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.538595:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07400/0x9df728c939b7a818 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.538602:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a81f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x27e1d104 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.538606:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a81f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x27e1d104 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.538609:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a81f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x27e1d104 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.538612:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06a00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050268.538614:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a81f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x27e1d104 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.538617:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a81f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x27e1d104 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.538629:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x27e1d104 (ffff950714b52600) 00010000:00010000:0.0:1789050268.538630:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050268.538632:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a81f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x27e1d104 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.538635:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a81f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x27e1d104 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050268.538702:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd1a549-5106-461c-9c28-9bc689851eed+28:17446:x1875954691624320:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 Request processed in 549us (776us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789050268.538708:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 44 00000100:00100000:2.0:1789050268.540779:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050268.540951:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691624448 00000100:00100000:0.0:1789050268.540958:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691624448 00000100:00100000:0.0:1789050268.541002:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 45 00000100:00100000:0.0:1789050268.541010:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+28:17446:x1875954691624448:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050268.541025:0:18934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050268.541042:0:18934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a826 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fed1 expref: -99 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.541072:0:18934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b7a82d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.541085:0:18934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b7a82d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.541095:0:18934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b7a82d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.541184:0:18934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a826 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fed1 expref: 30 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.541238:0:18934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06800/0x9df728c939b7a82d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fed1 expref: 29 pid: 18934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.541246:0:18934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff950714b52e00) 00010000:00010000:0.0:1789050268.541249:0:18934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789050268.541251:0:18934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06800, rc 0) 00000100:00100000:0.0:1789050268.541376:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+29:17446:x1875954691624448:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 366us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050268.541383:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 45 00000100:00100000:2.0:1789050268.545181:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050268.545400:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691624704 00000100:00100000:1.0:1789050268.545422:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691624704 00000100:00100000:1.0:1789050268.545748:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 46 00000100:00100000:1.0:1789050268.545994:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd1a549-5106-461c-9c28-9bc689851eed+29:17446:x1875954691624704:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789050268.546271:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8200/0x9df728c939b7a834 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050268.546288:0:18933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8200/0x9df728c939b7a834 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050268.546299:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8200/0x9df728c939b7a834 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789050268.547156:0:18933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:1.0:1789050268.547169:0:18933:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 504534969391ns, next at 505534966671ns, rc = 0 00000004:00010000:1.0:1789050268.550735:0:18933:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000c2028ccd reply state 000000005d7cd562 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8200/0x9df728c939b7a834 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050268.550753:0:18933:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789050268.551038:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd1a549-5106-461c-9c28-9bc689851eed+31:17446:x1875954691624704:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 Request processed in 5277us (5859us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1789050268.551047:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 46 00000100:00100000:2.0:1789050268.560723:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00010000:00010000:0.0:1789050268.560802:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8200/0x9df728c939b7a834 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.560815:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8200/0x9df728c939b7a834 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.560823:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8200/0x9df728c939b7a834 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.560829:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605cf8200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050268.560833:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8200/0x9df728c939b7a834 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.560841:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8200/0x9df728c939b7a834 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.560856:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff950714b52e00) 00010000:00010000:0.0:1789050268.560860:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789050268.560864:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8200/0x9df728c939b7a834 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.560881:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605cf8200/0x9df728c939b7a834 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18933 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050268.560932:0:20811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691624832 00000100:00100000:3.0:1789050268.560943:0:20811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691624832 00000100:00100000:3.0:1789050268.560996:0:20811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 47 00000100:00100000:3.0:1789050268.561007:0:20811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd1a549-5106-461c-9c28-9bc689851eed+30:17446:x1875954691624832:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050268.561040:0:20811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050268.561056:0:20811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a83b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fed8 expref: -99 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.561107:0:20811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a83b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fed8 expref: 31 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.561120:0:20811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a83b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fed8 expref: 31 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.561137:0:20811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff950714b52e00) 00010000:00010000:3.0:1789050268.561139:0:20811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789050268.561142:0:20811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703330c00, rc 0) 00000100:00100000:3.0:1789050268.565604:0:20811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd1a549-5106-461c-9c28-9bc689851eed+31:17446:x1875954691624832:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 196us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050268.565617:0:20811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 47 00000100:00100000:1.0:1789050268.567143:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050268.567247:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691624960 00000100:00100000:3.0:1789050268.567257:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691624960 00000100:00100000:3.0:1789050268.567312:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 12 00000100:00100000:3.0:1789050268.567322:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0fd1a549-5106-461c-9c28-9bc689851eed+5:2348:x1875954691624960:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789050268.567664:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0fd1a549-5106-461c-9c28-9bc689851eed+6:2348:x1875954691624960:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 Request processed in 343us (526us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789050268.567672:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 12 00000100:00080000:1.0:1789050268.567802:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789050268.574672:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050268.574749:0:18935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691625216 00000100:00100000:2.0:1789050268.574769:0:18935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691625216 00000100:00100000:2.0:1789050268.574822:0:18935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:2.0:1789050268.574832:0:18935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0fd1a549-5106-461c-9c28-9bc689851eed+31:17446:x1875954691625216:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789050268.575039:0:18935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0fd1a549-5106-461c-9c28-9bc689851eed+32:17446:x1875954691625216:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 Request processed in 206us (375us total) trans 12884901912 rc 0/0 00000100:00100000:2.0:1789050268.575046:0:18935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 9 00000100:00100000:2.0:1789050268.579741:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050268.580556:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691625472 00000100:00100000:0.0:1789050268.580566:0:18932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691625472 00000100:00100000:0.0:1789050268.580668:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 48 00000100:00100000:0.0:1789050268.580678:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd1a549-5106-461c-9c28-9bc689851eed+32:17446:x1875954691625472:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789050268.580788:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd1a549-5106-461c-9c28-9bc689851eed+32:17446:x1875954691625472:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 Request processed in 111us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050268.580796:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 48 00000100:00100000:2.0:1789050268.583637:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050268.587870:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691625600 00000100:00100000:1.0:1789050268.587882:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691625600 00000100:00100000:0.0:1789050268.587962:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 49 00000100:00100000:0.0:1789050268.587975:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd1a549-5106-461c-9c28-9bc689851eed+32:17446:x1875954691625600:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050268.587993:0:18932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050268.588011:0:18932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a842 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fedf expref: -99 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.588074:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a849 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.588089:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a849 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.588100:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a849 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789050268.588133:0:18932:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789050268.588148:0:18932:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a849 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.588186:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06c00/0x9df728c939b7a842 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fedf expref: 34 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.588227:0:18932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a849 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fedf expref: 33 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.588235:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff950714b52e00) 00010000:00010000:0.0:1789050268.588238:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789050268.588241:0:18932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f06a00, rc 0) 00000100:00100000:0.0:1789050268.588313:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd1a549-5106-461c-9c28-9bc689851eed+33:17446:x1875954691625600:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 341us (4684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050268.588319:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 49 00000100:00100000:2.0:1789050268.591728:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050268.591856:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691625728 00000100:00100000:3.0:1789050268.591865:0:19617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691625728 00000100:00100000:3.0:1789050268.591919:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 13 00000100:00100000:3.0:1789050268.591930:0:19617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0fd1a549-5106-461c-9c28-9bc689851eed+6:2347:x1875954691625728:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789050268.591959:0:19617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789050268.591978:0:19617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f10cdeb9/0x9df728c939b7a850 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34fee6 expref: -99 pid: 19617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789050268.592004:0:19617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fbbdbba8a000, blocks: 0x1 00010000:00010000:3.0:1789050268.592022:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=504s v=(0 0) 00010000:00010000:3.0:1789050268.592091:0:19617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050268.592336:0:19617:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f10cdeb9/0x9df728c939b7a850 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fee6 expref: 7 pid: 19617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.592356:0:19617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f10cdeb9/0x9df728c939b7a850 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fee6 expref: 7 pid: 19617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.592369:0:19617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950703331c00, rc 0) 00000100:00100000:3.0:1789050268.592652:0:19617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0fd1a549-5106-461c-9c28-9bc689851eed+7:2347:x1875954691625728:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 723us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050268.592661:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 13 00000100:00100000:2.0:1789050268.597630:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050268.597733:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691625984 00000100:00100000:3.0:1789050268.597743:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691625984 00000100:00100000:3.0:1789050268.597897:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 50 00000100:00100000:3.0:1789050268.597911:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+33:17446:x1875954691625984:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789050268.598008:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd1a549-5106-461c-9c28-9bc689851eed+33:17446:x1875954691625984:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 Request processed in 101us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050268.598015:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 50 00000100:00100000:2.0:1789050268.601669:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050268.601907:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691626112 00000100:00100000:1.0:1789050268.601915:0:18933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691626112 00000100:00100000:1.0:1789050268.601966:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 51 00000100:00100000:1.0:1789050268.601977:0:18933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd1a549-5106-461c-9c28-9bc689851eed+33:17446:x1875954691626112:12345-192.168.206.1@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789050268.643154:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000001:00080000:0.0:1789050268.643181:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901894 is committed 00000001:00080000:0.0:1789050268.644140:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901911 is committed 00000004:00080000:0.0:1789050268.644148:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789050268.644174:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000001:00080000:0.0:1789050268.644180:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901912 is committed 00000100:00100000:0.0:1789050268.644405:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704186112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789050268.644482:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050268.644681:0:20809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704186112 00000100:00100000:2.0:1789050268.644689:0:20809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704186112 00000100:00100000:2.0:1789050268.644753:0:20809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789050268.644762:0:20809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875954704186112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789050268.644896:0:20809:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789050268.644900:0:20809:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789050268.644902:0:20809:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789050268.644905:0:20809:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1789050269312000000 -> 1789050269312000000 00002000:00010000:2.0:1789050268.644907:0:20809:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789050268.644948:0:20809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1875954704186112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 188us (465us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1789050268.644955:0:20809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1789050268.644994:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95073c577100/2, rc 0, transno 12884901891 00000100:00100000:2.0:1789050268.644999:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1875954704186112:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1789050268.645117:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789050268.645404:0:18933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd1a549-5106-461c-9c28-9bc689851eed+14:17446:x1875954691626112:12345-192.168.206.1@tcp:44:lhsmtool_posix.0 Request processed in 43427us (43740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050268.645424:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 51 00000100:00100000:2.0:1789050268.647950:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050268.648046:0:19616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691626240 00000100:00100000:1.0:1789050268.648055:0:19616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691626240 00000100:00100000:1.0:1789050268.648108:0:19616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:1.0:1789050268.648118:0:19616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0fd1a549-5106-461c-9c28-9bc689851eed+7:2348:x1875954691626240:12345-192.168.206.1@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789050268.648231:0:19616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0fd1a549-5106-461c-9c28-9bc689851eed+7:2348:x1875954691626240:12345-192.168.206.1@tcp:16:lhsmtool_posix.0 Request processed in 113us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050268.648238:0:19616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:1.0:1789050268.650926:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050268.651089:0:20811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691626496 00000100:00100000:2.0:1789050268.651098:0:20811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691626496 00000100:00100000:2.0:1789050268.651195:0:20811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 52 00000100:00100000:2.0:1789050268.651222:0:20811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd1a549-5106-461c-9c28-9bc689851eed+14:17446:x1875954691626496:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789050268.651269:0:20811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050268.651293:0:20811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06a00/0x9df728c939b7a849 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fedf expref: 14 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.651318:0:20811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff950714b52e00) 00010000:00010000:2.0:1789050268.651324:0:20811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789050268.651351:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a857 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.651380:0:20811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a857 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.651392:0:20811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a857 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789050268.651577:0:20811:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000d1bda48f reply state 00000000d162d83d transno 12884901913 ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a857 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050268.651586:0:20811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789050268.651862:0:20811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd1a549-5106-461c-9c28-9bc689851eed+15:17446:x1875954691626496:12345-192.168.206.1@tcp:36:lhsmtool_posix.0 Request processed in 642us (942us total) trans 12884901913 rc 0/0 00000100:00100000:2.0:1789050268.651871:0:20811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 52 00000100:00100000:2.0:1789050268.654892:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050268.655213:0:20809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691626624 00000100:00100000:0.0:1789050268.655222:0:20809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691626624 00000100:00100000:0.0:1789050268.655277:0:20809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 16 00000100:00100000:0.0:1789050268.655286:0:20809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0fd1a549-5106-461c-9c28-9bc689851eed+7:17446:x1875954691626624:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789050268.655302:0:20809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789050268.655319:0:20809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b7a85e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x43b832a43b34feed expref: -99 pid: 20809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.655358:0:20809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f10cdeb9/0x9df728c939b7a850 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fee6 expref: 8 pid: 19617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.655367:0:20809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050268.655370:0:20809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050268.655375:0:20809:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b7a85e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34feed expref: 8 pid: 20809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.655406:0:20809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f10cdeb9/0x9df728c939b7a850 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fee6 expref: 8 pid: 19617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.655420:0:20809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f10cdeb9/0x9df728c939b7a850 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fee6 expref: 8 pid: 19617 timeout: 604 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050268.655433:0:20809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:20809:1875954704186240:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050268.655508:0:20809:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728c9a540 going to sleep for 11 seconds 00010000:00010000:3.0:1789050268.658344:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a857 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.658359:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a857 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.658367:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a857 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.658373:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701489c00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:3.0:1789050268.658377:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a857 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.658385:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a857 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.658400:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff950714b52e00) 00010000:00010000:3.0:1789050268.658403:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789050268.658407:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a857 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.658413:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950701489c00/0x9df728c939b7a857 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050268.658676:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050268.658953:0:18918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691626752 00000100:00100000:3.0:1789050268.658961:0:18918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691626752 00010000:00010000:3.0:1789050268.658996:0:18918:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f10cdeb9/0x9df728c939b7a850 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fee6 expref: 9 pid: 19617 timeout: 604 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050268.659041:0:18918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 13 00000100:00100000:3.0:1789050268.659065:0:18918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0fd1a549-5106-461c-9c28-9bc689851eed+9:2347:x1875954691626752:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789050268.659079:0:18918:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789050268.659099:0:18918:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f10cdeb9/0x9df728c939b7a850 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fee6 expref: 9 pid: 19617 timeout: 604 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.659112:0:18918:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f10cdeb9/0x9df728c939b7a850 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fee6 expref: 9 pid: 19617 timeout: 604 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.659131:0:18918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050268.659136:0:18918:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050268.659142:0:18918:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b7a85e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34feed expref: 9 pid: 20809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.659151:0:18918:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b7a85e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34feed expref: 9 pid: 20809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.659185:0:18918:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b7a85e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34feed expref: 9 pid: 20809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050268.659222:0:18918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cd6f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:18918:1875954704186368:192.168.206.1@tcp:105: 00000100:00100000:3.0:1789050268.659286:0:18918:0:(client.c:2716:ptlrpc_set_wait()) set ffff950606eb3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789050268.662380:0:18918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cd6f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:18918:1875954704186368:192.168.206.1@tcp:105: 00010000:00010000:3.0:1789050268.662406:0:18918:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789050268.662501:0:18918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0fd1a549-5106-461c-9c28-9bc689851eed+9:2347:x1875954691626752:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 3437us (3827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789050268.662528:0:18918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 13 00010000:00010000:0.0:1789050268.662664:0:20809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f10cdeb9/0x9df728c939b7a850 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fee6 expref: 8 pid: 19617 timeout: 604 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050268.662681:0:20809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:20809:1875954704186240:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050268.662700:0:20809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b7a85e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34feed expref: 7 pid: 20809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.662726:0:20809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff950605f07400, rc 0) 00000100:00100000:1.0:1789050268.662828:0:20809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0fd1a549-5106-461c-9c28-9bc689851eed+7:17446:x1875954691626624:12345-192.168.206.1@tcp:101:lhsmtool_posix.0 Request processed in 7542us (7943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050268.662836:0:20809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 16 00000100:00100000:1.0:1789050268.666173:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050268.666401:0:19616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691626880 00000100:00100000:2.0:1789050268.666411:0:19616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691626880 00000100:00100000:2.0:1789050268.666470:0:19616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 17 00000100:00100000:2.0:1789050268.666479:0:19616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0fd1a549-5106-461c-9c28-9bc689851eed+7:2348:x1875954691626880:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789050268.666655:0:19616:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789050268.666659:0:19616:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1789050268554000000 00002000:00010000:2.0:1789050268.666662:0:19616:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 1789050267840511748 00002000:00010000:2.0:1789050268.666664:0:19616:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1789050269312000000 -> 1789050268554000000 00002000:00010000:2.0:1789050268.666666:0:19616:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789050268.666724:0:19616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0fd1a549-5106-461c-9c28-9bc689851eed+8:2348:x1875954691626880:12345-192.168.206.1@tcp:2:lhsmtool_posix.0 Request processed in 245us (557us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1789050268.666730:0:19616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 17 00000100:00100000:1.0:1789050268.669654:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050268.669741:0:19614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691627008 00000100:00100000:0.0:1789050268.669815:0:19614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691627008 00000100:00100000:0.0:1789050268.669905:0:19614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 18 00000100:00100000:0.0:1789050268.669916:0:19614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0fd1a549-5106-461c-9c28-9bc689851eed+8:2348:x1875954691627008:12345-192.168.206.1@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789050268.669952:0:19614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000041740d10/0x9df728c939b7a865 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.669969:0:19614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b7a85e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34feed expref: 8 pid: 20809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.669977:0:19614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050268.669982:0:19614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789050268.669986:0:19614:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041740d10/0x9df728c939b7a865 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.670017:0:19614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b7a85e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34feed expref: 8 pid: 20809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.670038:0:19614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b7a85e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34feed expref: 8 pid: 20809 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050268.670051:0:19614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19614:1875954704186496:192.168.206.1@tcp:104: 00000100:00100000:0.0:1789050268.670160:0:19614:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728c9a540 going to sleep for 11 seconds 00000100:00100000:1.0:1789050268.674158:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050268.674244:0:18919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691627136 00000100:00100000:2.0:1789050268.674265:0:18919:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691627136 00010000:00010000:2.0:1789050268.674299:0:18919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b7a85e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34feed expref: 9 pid: 20809 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050268.674340:0:18919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:2.0:1789050268.674349:0:18919:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0fd1a549-5106-461c-9c28-9bc689851eed+9:2348:x1875954691627136:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050268.674364:0:18919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050268.674386:0:18919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b7a85e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34feed expref: 9 pid: 20809 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.674399:0:18919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b7a85e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34feed expref: 9 pid: 20809 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.674423:0:18919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789050268.674427:0:18919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789050268.674432:0:18919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000041740d10/0x9df728c939b7a865 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.674441:0:18919:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041740d10/0x9df728c939b7a865 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.674469:0:18919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050268.674521:0:18919:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0fd1a549-5106-461c-9c28-9bc689851eed+9:2348:x1875954691627136:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 172us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050268.674528:0:18919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 14 00010000:00010000:0.0:1789050268.676337:0:19614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db36fd7d/0x9df728c939b7a85e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34feed expref: 8 pid: 20809 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050268.676362:0:19614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19614:1875954704186496:192.168.206.1@tcp:104: 00010000:00010000:0.0:1789050268.676383:0:19614:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000041740d10/0x9df728c939b7a865 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.676396:0:19614:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000041740d10/0x9df728c939b7a865 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.676402:0:19614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041740d10/0x9df728c939b7a865 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.676431:0:19614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000041740d10/0x9df728c939b7a865 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.676440:0:19614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041740d10/0x9df728c939b7a865 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.676458:0:19614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041740d10/0x9df728c939b7a865 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.676465:0:19614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06e00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:0.0:1789050268.676469:0:19614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041740d10/0x9df728c939b7a865 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.676500:0:19614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041740d10/0x9df728c939b7a865 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.676517:0:19614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041740d10/0x9df728c939b7a865 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.676525:0:19614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041740d10/0x9df728c939b7a865 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050268.676614:0:19614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0fd1a549-5106-461c-9c28-9bc689851eed+7:2348:x1875954691627008:12345-192.168.206.1@tcp:1:lhsmtool_posix.0 Request processed in 6699us (6966us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050268.676623:0:19614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 18 00000100:00100000:1.0:1789050268.679548:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050268.679635:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691627392 00000100:00100000:0.0:1789050268.679644:0:18932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691627392 00000100:00100000:0.0:1789050268.679731:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 53 00000100:00100000:0.0:1789050268.679741:0:18932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd1a549-5106-461c-9c28-9bc689851eed+14:17446:x1875954691627392:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789050268.679823:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7a86c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.679838:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7a86c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.679851:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7a86c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.680077:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a873 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.680094:0:18932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a83b lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fed8 expref: 15 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.680103:0:18932:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a873 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.680133:0:18932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a83b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fed8 expref: 15 pid: 20811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.680146:0:18932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a83b lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fed8 expref: 15 pid: 20811 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050268.680159:0:18932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18932:1875954704186624:192.168.206.1@tcp:104: 00000100:00100000:1.0:1789050268.680627:0:18932:0:(client.c:2716:ptlrpc_set_wait()) set ffff950728c9a540 going to sleep for 11 seconds 00000100:00100000:1.0:1789050268.685240:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050268.685481:0:18918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691627520 00000100:00100000:2.0:1789050268.685490:0:18918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691627520 00010000:00010000:2.0:1789050268.685538:0:18918:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a83b lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fed8 expref: 16 pid: 20811 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050268.685579:0:18918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 15 00000100:00100000:2.0:1789050268.685588:0:18918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0fd1a549-5106-461c-9c28-9bc689851eed+16:2347:x1875954691627520:12345-192.168.206.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789050268.685603:0:18918:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789050268.685610:0:18918:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a83b lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fed8 expref: 16 pid: 20811 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.685622:0:18918:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a83b lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fed8 expref: 16 pid: 20811 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.685643:0:18918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff950714b52e00) 00010000:00010000:2.0:1789050268.685648:0:18918:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a873 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.685658:0:18918:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a873 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.685666:0:18918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a873 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.685684:0:18918:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789050268.685735:0:18918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0fd1a549-5106-461c-9c28-9bc689851eed+16:2347:x1875954691627520:12345-192.168.206.1@tcp:103:ldlm_bl.0 Request processed in 147us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050268.685742:0:18918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 15 00010000:00010000:3.0:1789050268.689314:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a83b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.1@tcp remote: 0x43b832a43b34fed8 expref: 15 pid: 20811 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050268.689341:0:18932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c515180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18932:1875954704186624:192.168.206.1@tcp:104: 00010000:00010000:3.0:1789050268.689361:0:18932:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a873 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.689370:0:18932:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a873 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.689375:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a873 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789050268.689668:0:18932:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000001:00080000:3.0:1789050268.689832:0:18932:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000001:00080000:3.0:1789050268.689877:0:18932:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901916 00000100:00100000:3.0:1789050268.689953:0:18932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073cd6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18932:1875954704186752:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789050268.690011:0:18932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789050268.690269:0:18932:0:(client.c:2716:ptlrpc_set_wait()) set ffff950703419840 going to sleep for 11 seconds 00000100:00100000:1.0:1789050268.693254:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704186752 00000100:00100000:1.0:1789050268.693269:0:18937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704186752 00000100:00100000:1.0:1789050268.693320:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789050268.693330:0:18937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18932:x1875954704186752:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789050268.693467:0:18937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18932:x1875954704186752:12345-0@lo:1000:mdt00_000.0 Request processed in 136us (3454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050268.693474:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789050268.693732:0:18932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073cd6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18932:1875954704186752:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789050268.694976:0:18932:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00000100:00100000:2.0:1789050268.698934:0:18932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c575f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18932:1875954704186880:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789050268.699000:0:18932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789050268.699151:0:18932:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704939780 going to sleep for 11 seconds 00000100:00100000:1.0:1789050268.699259:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704186880 00000100:00100000:1.0:1789050268.699268:0:18937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704186880 00000100:00100000:1.0:1789050268.699359:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789050268.699369:0:18937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18932:x1875954704186880:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789050268.699728:0:18937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:18932:x1875954704186880:12345-0@lo:1000:mdt00_000.0 Request processed in 359us (726us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1789050268.699736:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789050268.699877:0:18932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c575f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18932:1875954704186880:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789050268.699914:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a873 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.699925:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a873 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.699933:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a873 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.699939:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07000 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050268.699943:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a873 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.699951:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a873 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.699964:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff950714b52e00) 00010000:00010000:2.0:1789050268.699966:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789050268.699971:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a873 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.699976:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07000/0x9df728c939b7a873 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.700007:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7a7cb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.700014:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7a7cb lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.700019:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7a7cb lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.700044:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07200 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:2.0:1789050268.700048:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7a7cb lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.700054:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7a7cb lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.700062:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff950714b52800) 00010000:00010000:2.0:1789050268.700065:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789050268.700071:0:18932:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a7d2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34febc expref: 18 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.700081:0:18932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a7d2 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34febc expref: 18 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.700090:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a7d2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34febc expref: 18 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.700120:0:18932:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff950703330400/0x9df728c939b7a7d2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.1@tcp remote: 0x43b832a43b34febc expref: 18 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050268.700129:0:18932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff95073c576300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18932:1875954704187008:192.168.206.1@tcp:105: 00000100:00100000:2.0:1789050268.700226:0:18932:0:(client.c:2716:ptlrpc_set_wait()) set ffff950704939780 going to sleep for 11 seconds 00000100:00100000:3.0:1789050268.704099:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050268.704223:0:18932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff95073c576300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18932:1875954704187008:192.168.206.1@tcp:105: 00010000:00010000:0.0:1789050268.704249:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7a7cb lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.704258:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07200/0x9df728c939b7a7cb lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18934 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.704293:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a87a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.704306:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a87a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.704318:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a87a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.704345:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a87a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.704352:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a87a lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.704358:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a87a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.704364:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f06e00 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050268.704367:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a87a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.704385:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a87a lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.704396:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff950714b52800) 00010000:00010000:0.0:1789050268.704399:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789050268.704402:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a87a lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.704407:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f06e00/0x9df728c939b7a87a lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.704422:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7a86c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.704427:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7a86c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.704433:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7a86c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.704462:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07800 already unused, calling callback (ffffffffc22364f0) 00010000:00010000:0.0:1789050268.704465:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7a86c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.704472:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7a86c lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.704481:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff950714b52800) 00010000:00010000:0.0:1789050268.704484:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789050268.704486:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7a86c lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.704492:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950605f07800/0x9df728c939b7a86c lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050268.705974:0:18932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd1a549-5106-461c-9c28-9bc689851eed+18:17446:x1875954691627392:12345-192.168.206.1@tcp:57:lhsmtool_posix.0 Request processed in 26226us (26425us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1789050268.705987:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 53 00000020:00080000:0.0:1789050268.705993:0:18932:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789050268.706132:0:18964:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789050268.706137:0:18964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789050268.706167:0:18964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1789050268.706173:0:18964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1789050268.706515:0:18935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691627648 00000100:00100000:2.0:1789050268.706524:0:18935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691627648 00000100:00100000:2.0:1789050268.706571:0:18935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:2.0:1789050268.706580:0:18935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950604dd1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0fd1a549-5106-461c-9c28-9bc689851eed+18:17445:x1875954691627648:12345-192.168.206.1@tcp:49:dd.0 00000100:00100000:2.0:1789050268.706704:0:18935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950604dd1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0fd1a549-5106-461c-9c28-9bc689851eed+18:17445:x1875954691627648:12345-192.168.206.1@tcp:49:dd.0 Request processed in 125us (2614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050268.706711:0:18935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 10 00000100:00100000:2.0:1789050268.712101:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050268.716771:0:18935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691627904 00000100:00100000:3.0:1789050268.716785:0:18935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691627904 00000100:00100000:3.0:1789050268.716858:0:18935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 11 00000100:00100000:3.0:1789050268.716868:0:18935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0fd1a549-5106-461c-9c28-9bc689851eed+18:17446:x1875954691627904:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789050268.717869:0:18935:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789050268.717973:0:18935:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901919 00010000:00010000:3.0:1789050268.718016:0:18935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a881 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.718102:0:18935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a881 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 18935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.718115:0:18935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a881 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.718124:0:18935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a881 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.718130:0:18935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a881 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.718136:0:18935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a881 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.718224:0:18935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789050268.718317:0:18935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0fd1a549-5106-461c-9c28-9bc689851eed+20:17446:x1875954691627904:12345-192.168.206.1@tcp:35:lhsmtool_posix.0 Request processed in 1448us (6222us total) trans 12884901920 rc 0/0 00000100:00100000:3.0:1789050268.718327:0:18935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 11 00000020:00080000:3.0:1789050268.718332:0:18935:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789050268.721607:0:20607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789050268.721619:0:20607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a881 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.721630:0:20607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050268.721634:0:20607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a881 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.721644:0:20607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a881 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 18935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.721661:0:20607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff950714b52e00) 00010000:00010000:2.0:1789050268.721664:0:20607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789050268.721669:0:20607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a881 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.721675:0:20607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff950703330c00/0x9df728c939b7a881 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.721735:0:20607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050268.721736:0:20607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789050268.721738:0:20607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789050268.833285:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050268.833423:0:19620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691628032 00000100:00100000:3.0:1789050268.833432:0:19620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691628032 00000100:00100000:3.0:1789050268.833506:0:19620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 0 00000100:00100000:3.0:1789050268.833516:0:19620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0fd1a549-5106-461c-9c28-9bc689851eed+7:2349:x1875954691628032:12345-192.168.206.1@tcp:4:dd.0 00002000:00010000:3.0:1789050268.833560:0:19620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x18d3fbbd8e7a7680, atime: 0x18d3fbbd63f37f04, ctime: 0x18d3fbbd8e7a7680, blocks: 0x1 00010000:00010000:3.0:1789050268.833581:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b7a888 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.833597:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=504s v=(0 0) 00010000:00010000:3.0:1789050268.833602:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050268.833609:0:19620:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b7a888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.833624:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b7a888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050268.837548:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050268.837638:0:19622:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789050268.837647:0:19622:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1789050268.838016:0:19622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691628288 00000100:00100000:3.0:1789050268.838032:0:19622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691628288 00000100:00100000:1.0:1789050268.838569:0:21065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 1 00000100:00100000:1.0:1789050268.838580:0:21065:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073cd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0fd1a549-5106-461c-9c28-9bc689851eed+9:2348:x1875954691628288:12345-192.168.206.1@tcp:4:dd.0 00010000:00010000:1.0:1789050268.838609:0:21065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b092/0x9df728c939b7a88f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050268.838625:0:21065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050268.838629:0:21065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050268.838634:0:21065:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b092/0x9df728c939b7a88f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050268.838648:0:21065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b092/0x9df728c939b7a88f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050268.841544:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050268.843370:0:19622:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1789050268.843465:0:19622:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1789050268.844006:0:19622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691628160 00000100:00100000:2.0:1789050268.844016:0:19622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691628160 00000100:00100000:2.0:1789050268.844970:0:19622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 2 00000100:00100000:2.0:1789050268.844981:0:19622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0fd1a549-5106-461c-9c28-9bc689851eed+11:2350:x1875954691628160:12345-192.168.206.1@tcp:4:dd.0 00010000:00010000:2.0:1789050268.845015:0:19622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de62d24d/0x9df728c939b7a896 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.845040:0:19622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050268.845044:0:19622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789050268.845051:0:19622:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de62d24d/0x9df728c939b7a896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.845066:0:19622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de62d24d/0x9df728c939b7a896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050268.880885:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050268.880930:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050268.881113:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691628544 00000100:00100000:0.0:1789050268.881122:0:19617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691628544 00000100:00100000:0.0:1789050268.881171:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691628800 00000100:00100000:0.0:1789050268.881175:0:19617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691628800 00000100:00100000:0.0:1789050268.881223:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 12 00000100:00100000:0.0:1789050268.881231:0:19617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0fd1a549-5106-461c-9c28-9bc689851eed+5:2348:x1875954691628544:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789050268.881291:0:19617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0fd1a549-5106-461c-9c28-9bc689851eed+5:2348:x1875954691628544:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 59us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050268.881300:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 12 00000100:00100000:0.0:1789050268.881324:0:20809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 13 00000100:00100000:0.0:1789050268.881331:0:20809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1940353c-2b2a-4224-bbac-3372d105601d+5:2348:x1875954691628800:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789050268.881354:0:20809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1940353c-2b2a-4224-bbac-3372d105601d+5:2348:x1875954691628800:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 24us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050268.881361:0:20809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 13 00000100:00100000:0.0:1789050268.881404:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050268.881470:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00080000:1.0:1789050268.882664:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789050268.882669:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789050268.886286:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691628672 00000100:00100000:2.0:1789050268.886300:0:18934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691628672 00000100:00100000:2.0:1789050268.886372:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 24 00000100:00100000:2.0:1789050268.886384:0:18934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1940353c-2b2a-4224-bbac-3372d105601d+6:2348:x1875954691628672:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050268.886471:0:18934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1940353c-2b2a-4224-bbac-3372d105601d+6:2348:x1875954691628672:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 89us (4999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050268.886478:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 24 00000100:00100000:2.0:1789050268.886505:0:18926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691628416 00000100:00100000:2.0:1789050268.886509:0:18926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691628416 00000100:00100000:2.0:1789050268.886536:0:18926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 121 00000100:00100000:2.0:1789050268.886543:0:18926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950707944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+13:2348:x1875954691628416:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:2.0:1789050268.886569:0:18926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950707944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b83cae77-0a6f-4d94-80d9-6507de3f20fd+13:2348:x1875954691628416:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 26us (5164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789050268.886590:0:18926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 121 00000100:00080000:1.0:1789050268.886927:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789050268.898430:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:0.0:1789050268.898535:0:20809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691628928 00000100:00100000:0.0:1789050268.898543:0:20809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691628928 00000100:00100000:0.0:1789050268.898599:0:20809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00100000:0.0:1789050268.898609:0:20809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1940353c-2b2a-4224-bbac-3372d105601d+5:2348:x1875954691628928:12345-192.168.206.1@tcp:400:kworker.0 00000100:00100000:0.0:1789050268.898702:0:20809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1940353c-2b2a-4224-bbac-3372d105601d+5:2348:x1875954691628928:12345-192.168.206.1@tcp:400:kworker.0 Request processed in 94us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789050268.898709:0:20809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 14 00000100:00080000:0.0:1789050268.898729:0:18928:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789050268.924429:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901893 is committed 00000001:00080000:0.0:1789050268.924457:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:2.0:1789050268.927632:0:19620:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1789050268.927640:0:19620:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 1789050268554000000 -> 1789050269483000000 00002000:00010000:2.0:1789050268.927644:0:19620:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:2.0:1789050268.927658:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b7a888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.927671:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b7a888 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.927680:0:19620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b7a888 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.927687:0:19620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330800 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050268.927692:0:19620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b7a888 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.927701:0:19620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b7a888 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.927720:0:19620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b7a888 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050268.927741:0:19620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b7a888 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050268.927829:0:19620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0fd1a549-5106-461c-9c28-9bc689851eed+13:2349:x1875954691628032:12345-192.168.206.1@tcp:4:dd.0 Request processed in 94310us (94550us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1789050268.927848:0:19620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 0 00000001:00080000:0.0:1789050268.973528:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:0.0:1789050268.973550:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00010000:00010000:3.0:1789050268.973596:0:19622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de62d24d/0x9df728c939b7a896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.973610:0:19622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de62d24d/0x9df728c939b7a896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.973618:0:19622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de62d24d/0x9df728c939b7a896 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.973625:0:19622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950701488400 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050268.973630:0:19622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de62d24d/0x9df728c939b7a896 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.973638:0:19622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de62d24d/0x9df728c939b7a896 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.973677:0:19622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de62d24d/0x9df728c939b7a896 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.973685:0:19622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de62d24d/0x9df728c939b7a896 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050268.973771:0:19622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0fd1a549-5106-461c-9c28-9bc689851eed+7:2350:x1875954691628160:12345-192.168.206.1@tcp:4:dd.0 Request processed in 128787us (132233us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1789050268.973780:0:19622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 2 00010000:00010000:3.0:1789050268.973836:0:21065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b092/0x9df728c939b7a88f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.973845:0:21065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b092/0x9df728c939b7a88f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.973852:0:21065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b092/0x9df728c939b7a88f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.973858:0:21065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605cf9e00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050268.973862:0:21065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b092/0x9df728c939b7a88f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.973869:0:21065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b092/0x9df728c939b7a88f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.973891:0:21065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b092/0x9df728c939b7a88f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.973899:0:21065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9f6b092/0x9df728c939b7a88f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050268.973940:0:21065:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073cd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0fd1a549-5106-461c-9c28-9bc689851eed+5:2348:x1875954691628288:12345-192.168.206.1@tcp:4:dd.0 Request processed in 135362us (136399us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1789050268.973947:0:21065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 1 00000100:00100000:1.0:1789050268.981418:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050268.981470:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050268.981574:0:21066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691629056 00000100:00100000:3.0:1789050268.981584:0:21066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691629056 00000100:00100000:3.0:1789050268.981718:0:21066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691629184 00000100:00100000:3.0:1789050268.981723:0:21066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691629184 00000100:00100000:3.0:1789050268.981758:0:19622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 3 00000100:00100000:3.0:1789050268.981767:0:19622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0fd1a549-5106-461c-9c28-9bc689851eed+6:2347:x1875954691629056:12345-192.168.206.1@tcp:4:dd.0 00002000:00010000:3.0:1789050268.981814:0:19622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 3145728, mtime: 0x18d3fbbdc5d9e0c0, atime: 0x18d3fbbd63f37f04, ctime: 0x0, blocks: 0x1807 00010000:00010000:3.0:1789050268.981823:0:19622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d79c038/0x9df728c939b7a89d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.981837:0:19622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=504s v=(0 0) 00010000:00010000:3.0:1789050268.981841:0:19622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050268.981847:0:19622:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d79c038/0x9df728c939b7a89d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.981860:0:19622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d79c038/0x9df728c939b7a89d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789050268.981949:0:19620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 4 00000100:00100000:0.0:1789050268.981967:0:19620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0fd1a549-5106-461c-9c28-9bc689851eed+7:2347:x1875954691629184:12345-192.168.206.1@tcp:4:dd.0 00010000:00010000:0.0:1789050268.981988:0:19620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066e11842/0x9df728c939b7a8a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.981999:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050268.982002:0:19620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789050268.982007:0:19620:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066e11842/0x9df728c939b7a8a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789050268.982034:0:19620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066e11842/0x9df728c939b7a8a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050268.982131:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:3.0:1789050268.982355:0:21065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691629312 00000100:00100000:3.0:1789050268.982360:0:21065:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691629312 00000100:00100000:3.0:1789050268.982396:0:21065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 5 00000100:00100000:3.0:1789050268.982402:0:21065:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0fd1a549-5106-461c-9c28-9bc689851eed+9:2348:x1875954691629312:12345-192.168.206.1@tcp:4:dd.0 00010000:00010000:3.0:1789050268.982417:0:21065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b7a8ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.982426:0:21065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050268.982429:0:21065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050268.982434:0:21065:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b7a8ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050268.982443:0:21065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b7a8ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050268.986804:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:1.0:1789050268.986908:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.1@tcp (source: 12345-192.168.206.1@tcp) 00000100:00100000:2.0:1789050268.986994:0:21066:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1789050268.987005:0:21066:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:3.0:1789050268.987022:0:19621:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1789050268.987037:0:19621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691629440 00000100:00100000:3.0:1789050268.987046:0:19621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691629440 00000100:00100000:3.0:1789050268.987092:0:19621:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1789050268.987100:0:19621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954691629568 00000100:00100000:3.0:1789050268.987103:0:19621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954691629568 00000100:00100000:1.0:1789050268.988902:0:21067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 6 00000100:00100000:1.0:1789050268.988916:0:21067:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0fd1a549-5106-461c-9c28-9bc689851eed+12:2348:x1875954691629440:12345-192.168.206.1@tcp:4:dd.0 00010000:00010000:1.0:1789050268.988951:0:21067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf2f237/0x9df728c939b7a8b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050268.988968:0:21067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050268.988972:0:21067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789050268.988978:0:21067:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adf2f237/0x9df728c939b7a8b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050268.988992:0:21067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adf2f237/0x9df728c939b7a8b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789050269.057193:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901897 is committed 00002000:00010000:3.0:1789050269.057669:0:19622:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 3145728 -> 7340032 00002000:00010000:3.0:1789050269.057674:0:19622:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 1789050269483000000 -> 1789050269749865668 00002000:00010000:3.0:1789050269.057677:0:19622:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 0 -> 1789050269749865668 00002000:00010000:3.0:1789050269.057680:0:19622:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1789050269.057692:0:19622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d79c038/0x9df728c939b7a89d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050269.057714:0:19622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d79c038/0x9df728c939b7a89d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050269.057724:0:19622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d79c038/0x9df728c939b7a89d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050269.057731:0:19622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050269.057736:0:19622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d79c038/0x9df728c939b7a89d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050269.057755:0:19622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d79c038/0x9df728c939b7a89d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050269.057777:0:19622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d79c038/0x9df728c939b7a89d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050269.057785:0:19622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d79c038/0x9df728c939b7a89d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050269.057878:0:19622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0fd1a549-5106-461c-9c28-9bc689851eed+18:2347:x1875954691629056:12345-192.168.206.1@tcp:4:dd.0 Request processed in 76107us (76464us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1789050269.057888:0:19622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 3 00000100:00100000:3.0:1789050269.057918:0:19622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.1@tcp, seq: 7 00000100:00100000:3.0:1789050269.057929:0:19622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff950606ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0fd1a549-5106-461c-9c28-9bc689851eed+17:2348:x1875954691629568:12345-192.168.206.1@tcp:4:dd.0 00010000:00010000:3.0:1789050269.057957:0:19622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f10cdeb9/0x9df728c939b7a8b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050269.057976:0:19622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789050269.057980:0:19622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789050269.057986:0:19622:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f10cdeb9/0x9df728c939b7a8b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050269.057997:0:19622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f10cdeb9/0x9df728c939b7a8b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789050269.107214:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901900 is committed 00002000:00010000:1.0:1789050269.107797:0:21067:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1789050269.107803:0:21067:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 8199 -> 14343 00010000:00010000:1.0:1789050269.107818:0:21067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf2f237/0x9df728c939b7a8b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050269.107832:0:21067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adf2f237/0x9df728c939b7a8b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050269.107841:0:21067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adf2f237/0x9df728c939b7a8b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050269.107849:0:21067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605cf9000 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050269.107864:0:21067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf2f237/0x9df728c939b7a8b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050269.107873:0:21067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf2f237/0x9df728c939b7a8b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050269.107893:0:21067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adf2f237/0x9df728c939b7a8b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050269.107901:0:21067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adf2f237/0x9df728c939b7a8b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050269.107990:0:21067:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0fd1a549-5106-461c-9c28-9bc689851eed+13:2348:x1875954691629440:12345-192.168.206.1@tcp:4:dd.0 Request processed in 119074us (121191us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1789050269.108000:0:21067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 6 00010000:00010000:1.0:1789050269.111225:0:19620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066e11842/0x9df728c939b7a8a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050269.111245:0:19620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066e11842/0x9df728c939b7a8a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050269.111255:0:19620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066e11842/0x9df728c939b7a8a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050269.111263:0:19620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950605f07200 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:1.0:1789050269.111268:0:19620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066e11842/0x9df728c939b7a8a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050269.111298:0:19620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066e11842/0x9df728c939b7a8a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050269.111319:0:19620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066e11842/0x9df728c939b7a8a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789050269.111328:0:19620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066e11842/0x9df728c939b7a8a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789050269.111428:0:19620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0fd1a549-5106-461c-9c28-9bc689851eed+11:2347:x1875954691629184:12345-192.168.206.1@tcp:4:dd.0 Request processed in 129461us (129954us total) trans 12884901898 rc 0/0 00000100:00100000:1.0:1789050269.111438:0:19620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 4 00002000:00010000:2.0:1789050269.112115:0:21065:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1789050269.112126:0:21065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b7a8ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050269.112136:0:21065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b7a8ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050269.112143:0:21065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b7a8ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050269.112149:0:21065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703330800 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:2.0:1789050269.112153:0:21065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b7a8ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050269.112160:0:21065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b7a8ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050269.112173:0:21065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b7a8ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789050269.112181:0:21065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7d8c9a6/0x9df728c939b7a8ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789050269.112252:0:21065:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0fd1a549-5106-461c-9c28-9bc689851eed+9:2348:x1875954691629312:12345-192.168.206.1@tcp:4:dd.0 Request processed in 129848us (130121us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1789050269.112259:0:21065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 5 00000001:00080000:2.0:1789050269.146260:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901901 is committed 00010000:00010000:3.0:1789050269.146632:0:19622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f10cdeb9/0x9df728c939b7a8b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050269.146647:0:19622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f10cdeb9/0x9df728c939b7a8b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050269.146657:0:19622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f10cdeb9/0x9df728c939b7a8b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050269.146665:0:19622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff950703331c00 already unused, calling callback (ffffffffc180b8f0) 00010000:00010000:3.0:1789050269.146669:0:19622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f10cdeb9/0x9df728c939b7a8b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050269.146679:0:19622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f10cdeb9/0x9df728c939b7a8b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050269.146696:0:19622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f10cdeb9/0x9df728c939b7a8b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789050269.146720:0:19622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f10cdeb9/0x9df728c939b7a8b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789050269.146946:0:19622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff950606ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0fd1a549-5106-461c-9c28-9bc689851eed+5:2348:x1875954691629568:12345-192.168.206.1@tcp:4:dd.0 Request processed in 89016us (160033us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1789050269.146957:0:19622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.1@tcp, seq: 7 00010000:00010000:3.0:1789050269.259496:0:18920:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789050269.835777:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704187136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789050269.835842:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789050269.836348:0:19619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954704187136 00000100:00100000:1.0:1789050269.836356:0:19619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954704187136 00000100:00100000:1.0:1789050269.836414:0:19619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789050269.836424:0:19619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff95073c517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704187136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789050269.836455:0:19619:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3859808256 avail 3849322496 00000100:00100000:1.0:1789050269.836501:0:19619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff95073c517800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875954704187136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789050269.836507:0:19619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789050269.836650:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901893 gen 2 00000004:00080000:0.0:1789050269.836656:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95073c577100, transno 12884901891 00000004:00080000:0.0:1789050269.836681:0:3283:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 12884901893 committed transno 12884901893 00000100:00100000:0.0:1789050269.836707:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff950606ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1875954704187136:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789050270.284110:0:20603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789050270.393890:0:21105:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1789050271.312604:0:18921:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 9497 lines, 9497 kept, 0 dropped, 0 bad.