00010000:00010000:2.0F:1788843359.812520:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1788843360.070761:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795734528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843360.070872:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843360.070958:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795734528 00000100:00100000:1.0:1788843360.070968:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795734528 00000100:00100000:1.0:1788843360.071044:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788843360.071055:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795734528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843360.071100:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788843360.071152:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795734528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843360.071159:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788843360.071184:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843360.071226:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795734528:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788843360.688267:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000020:00080000:1.0:1788843360.688279:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dab699160c0 refcount 2 committed 0 result 0 batchid 4294967528 00000020:00080000:1.0:1788843360.688285:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dab4893d800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dab69916540 00000020:00080000:1.0:1788843360.688288:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dab4893d300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8daa41c1e800 00000001:00080000:1.0:1788843360.688318:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:0.0F:1788843360.689461:0:14459:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967528 committed batchid 8 00000020:00080000:1.0:1788843360.689749:0:14459:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788843360.838545:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1788843361.092871:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843361.092908:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795734656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843361.092978:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843361.093035:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795734656 00000100:00100000:2.0:1788843361.093044:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795734656 00000100:00080000:3.0:1788843361.093078:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843361.093100:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788843361.093107:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795735040:0@lo:400:kworker.0 00000100:00100000:2.0:1788843361.093111:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795734656:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843361.093135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788843361.093145:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788843361.093163:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843361.093168:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795735168:0@lo:400:kworker.0 00000100:00100000:3.0:1788843361.093188:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843361.093190:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795734656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843361.093198:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788843361.093220:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795735040 00000100:00100000:0.0:1788843361.093226:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795735040 00000100:00100000:3.0:1788843361.093228:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795734656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843361.093269:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795735168 00000100:00100000:0.0:1788843361.093273:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795735168 00000100:00100000:1.0:1788843361.093635:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795734784:0@lo:400:kworker.0 00000100:00100000:1.0:1788843361.093672:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843361.093696:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795735296:0@lo:400:kworker.0 00000100:00100000:1.0:1788843361.093719:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843361.105029:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795735296 00000100:00100000:0.0:1788843361.105045:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795735296 00000100:00100000:0.0:1788843361.105117:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788843361.105129:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795735040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843361.105248:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795735040:12345-0@lo:400:kworker.0 Request processed in 121us (12111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843361.105256:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788843361.105320:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795735040:0@lo:400:kworker.0 00000100:00100000:0.0:1788843361.105369:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788843361.105377:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795735168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843361.105414:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795735168:12345-0@lo:400:kworker.0 Request processed in 38us (12224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843361.105420:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788843361.105447:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795735168:0@lo:400:kworker.0 00000100:00100000:0.0:1788843361.105754:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788843361.105767:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795735296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843361.105803:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795735296:12345-0@lo:400:kworker.0 Request processed in 40us (12083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843361.105810:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788843361.105873:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795734784 00000100:00100000:0.0:1788843361.105878:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795734784 00000100:00100000:0.0:1788843361.106056:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788843361.106065:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+19:3306:x1875737795734784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843361.106114:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+19:3306:x1875737795734784:12345-0@lo:400:kworker.0 Request processed in 51us (12441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843361.106121:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788843361.106158:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795734912:0@lo:400:kworker.0 00000100:00100000:0.0:1788843361.106191:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843361.108622:0:16114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795734912 00000100:00100000:2.0:1788843361.108636:0:16114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795734912 00000100:00100000:2.0:1788843361.108684:0:16114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788843361.108693:0:16114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795734912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843361.108782:0:16114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795734912:12345-0@lo:400:kworker.0 Request processed in 90us (2590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843361.108790:0:16114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788843361.108810:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843361.108838:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795734912:0@lo:400:kworker.0 00000100:00100000:1.0:1788843361.110167:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795735296:0@lo:400:kworker.0 00000100:00100000:1.0:1788843361.110198:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795734784:0@lo:400:kworker.0 00000040:00080000:0.0:1788843361.671503:0:14455:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788843361.671512:0:14455:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788843361.671543:0:14455:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788843361.671549:0:14455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788843361.862223:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843361.939736:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843361.939856:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775831808 00000100:00100000:2.0:1788843361.939867:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775831808 00000100:00080000:3.0:1788843361.939974:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843361.940259:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 54 00000100:00100000:2.0:1788843361.940271:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+12:14431:x1875737775831808:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788843361.940396:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+12:14431:x1875737775831808:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 Request processed in 127us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843361.940405:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 54 00000100:00100000:3.0:1788843361.944257:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843361.944320:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775832064 00000100:00100000:2.0:1788843361.944336:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775832064 00000100:00100000:2.0:1788843361.944429:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:2.0:1788843361.944448:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+12:14431:x1875737775832064:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788843361.945026:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+13:14431:x1875737775832064:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 578us (783us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1788843361.945034:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00010000:00010000:1.0:1788843362.884637:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843362.968862:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843362.968924:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843362.969001:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843362.969153:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775832448 00000100:00100000:3.0:1788843362.969171:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775832448 00000100:00100000:3.0:1788843362.969279:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:3.0:1788843362.969294:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2359:x1875737775832448:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843362.969457:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2359:x1875737775832448:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 166us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843362.969467:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:2.0:1788843362.970240:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775832192 00000100:00100000:2.0:1788843362.970250:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775832192 00000100:00100000:2.0:1788843362.970306:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 126 00000100:00100000:2.0:1788843362.970315:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+13:2359:x1875737775832192:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843362.970423:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+13:2359:x1875737775832192:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 109us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843362.970432:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 126 00000100:00080000:1.0:1788843362.971381:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843362.971914:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775832320 00000100:00100000:0.0:1788843362.971928:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775832320 00000100:00100000:0.0:1788843362.972008:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:0.0:1788843362.972019:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+13:2359:x1875737775832320:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843362.972111:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+13:2359:x1875737775832320:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 94us (3118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843362.972120:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:1.0:1788843362.982168:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843362.982225:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843362.982259:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843362.982305:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843362.982386:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775832576 00000100:00100000:1.0:1788843362.982400:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775832576 00000100:00100000:1.0:1788843362.982511:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775832832 00000100:00100000:1.0:1788843362.982514:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775832832 00000100:00100000:1.0:1788843362.982537:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775832960 00000100:00100000:1.0:1788843362.982540:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775832960 00000100:00100000:3.0:1788843362.982684:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1788843362.982703:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2355:x1875737775832576:12345-192.168.203.29@tcp:9:kworker.0 00000020:00000080:3.0:1788843362.982757:0:15108:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b091608e 00000100:00080000:3.0:1788843362.982780:0:15108:0:(import.c:65:import_set_state_nolock()) ffff8dab6e6e1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788843362.982876:0:15108:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1788843362.983278:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+2:2355:x1875737775832576:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 576us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843362.983301:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1788843362.983331:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:3.0:1788843362.983371:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:57dd4253-596f-4283-9b4c-1047ff1bcc24+5:2355:x1875737775832832:12345-192.168.203.29@tcp:9:kworker.0 00000020:00000080:3.0:1788843362.983391:0:15108:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b09160c6 00000100:00080000:3.0:1788843362.983402:0:15108:0:(import.c:65:import_set_state_nolock()) ffff8dab7c18c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788843362.983430:0:15108:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:3.0:1788843362.983604:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:57dd4253-596f-4283-9b4c-1047ff1bcc24+2:2355:x1875737775832832:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 264us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843362.983613:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:3.0:1788843362.983627:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:3.0:1788843362.983635:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:57dd4253-596f-4283-9b4c-1047ff1bcc24+5:2355:x1875737775832960:12345-192.168.203.29@tcp:9:kworker.0 00000020:00000080:3.0:1788843362.983650:0:15108:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b09160bf 00000100:00080000:3.0:1788843362.983657:0:15108:0:(import.c:65:import_set_state_nolock()) ffff8dab77927000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788843362.983671:0:15108:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1788843362.983752:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:57dd4253-596f-4283-9b4c-1047ff1bcc24+2:2355:x1875737775832960:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 118us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843362.983760:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00010000:00010000:3.0:1788843362.983787:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843362.983795:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788843362.984040:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788843362.984046:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788843362.985001:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775832704 00000100:00100000:0.0:1788843362.985017:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775832704 00000100:00080000:3.0:1788843362.985318:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843362.985496:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:0.0:1788843362.985512:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:2358:x1875737775832704:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843362.985762:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:2358:x1875737775832704:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 254us (3613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843362.985771:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 36 00010000:00010000:3.0:1788843363.908823:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843364.934606:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843365.190761:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795735424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843365.190861:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843365.190951:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795735424 00000100:00100000:2.0:1788843365.190961:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795735424 00000100:00100000:2.0:1788843365.191051:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843365.191062:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795735424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788843365.191113:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 68091904 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788843365.191167:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795735424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843365.191175:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843365.191233:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795735424:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788843365.192510:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:3.0:1788843365.756188:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967528 batchid updated 00000001:00080000:3.0:1788843365.756223:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:3.0:1788843365.756254:0:14459:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000020:00080000:3.0:1788843365.756266:0:14459:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00010000:00010000:3.0:1788843365.960612:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843366.212755:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795735552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843366.212852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843366.212938:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795736064:0@lo:400:kworker.0 00000100:00100000:0.0:1788843366.212951:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795735808:0@lo:400:kworker.0 00000100:00100000:3.0:1788843366.212981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843366.213008:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788843366.213017:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:845ba2f4-9198-464f-ba29-11072ff30647:3304:1875737795735680:0@lo:400:kworker.0 00000100:00100000:0.0:1788843366.213019:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843366.213051:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843366.213060:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795735936:0@lo:400:kworker.0 00000100:00100000:3.0:1788843366.213066:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843366.213097:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843366.213102:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875737795736192:0@lo:400:kworker.0 00000100:00100000:3.0:1788843366.213133:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843366.213176:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795735808 00000100:00100000:0.0:1788843366.213177:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795736064 00000100:00100000:3.0:1788843366.213187:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795735808 00000100:00100000:0.0:1788843366.213187:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795736064 00000100:00100000:0.0:1788843366.213240:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795735936 00000100:00100000:0.0:1788843366.213244:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795735936 00000100:00100000:0.0:1788843366.213257:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795736192 00000100:00100000:0.0:1788843366.213259:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795736192 00000100:00100000:0.0:1788843366.213274:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788843366.213284:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795736064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843366.213374:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795736064:12345-0@lo:400:kworker.0 Request processed in 91us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843366.213381:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788843366.213400:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788843366.213406:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795735936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843366.213442:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795735936:12345-0@lo:400:kworker.0 Request processed in 36us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843366.213447:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788843366.213459:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788843366.213465:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875737795736192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843366.213493:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875737795736192:12345-0@lo:400:kworker.0 Request processed in 29us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843366.213498:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788843366.213519:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795735552 00000100:00100000:0.0:1788843366.213523:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795735552 00000100:00100000:0.0:1788843366.213566:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788843366.213573:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795735552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843366.213609:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843366.213646:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795735552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843366.213652:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788843366.214393:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795735936:0@lo:400:kworker.0 00000100:00100000:3.0:1788843366.214522:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788843366.214809:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795735808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843366.214905:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795735808:12345-0@lo:400:kworker.0 Request processed in 106us (1887us total) trans 0 rc 0/0 00000100:00080000:0.0:1788843366.216442:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843366.216452:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843366.216489:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795735680 00000100:00100000:0.0:1788843366.216503:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795735680 00000100:00100000:0.0:1788843366.216736:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788843366.216750:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+19:3304:x1875737795735680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843366.216855:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+19:3304:x1875737795735680:12345-0@lo:400:kworker.0 Request processed in 108us (3792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843366.216863:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788843366.219222:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795735808:0@lo:400:kworker.0 00000100:00100000:2.0:1788843366.220495:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:845ba2f4-9198-464f-ba29-11072ff30647:3304:1875737795735680:0@lo:400:kworker.0 00000100:00100000:2.0:1788843366.220644:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875737795736192:0@lo:400:kworker.0 00000100:00100000:2.0:1788843366.220674:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795736064:0@lo:400:kworker.0 00000100:00100000:2.0:1788843366.220701:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795735552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843366.222446:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000001:00100000:0.0:1788843366.260197:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 57dd4253-596f-4283-9b4c-1047ff1bcc24 00000020:00000080:0.0:1788843366.260210:0:6719:0:(genops.c:885:class_export_put()) final put ffff8dab7c18a000/57dd4253-596f-4283-9b4c-1047ff1bcc24 00000020:00000080:0.0:1788843366.260248:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7c18a000/57dd4253-596f-4283-9b4c-1047ff1bcc24 for lustre-OST0000 00000020:00000080:0.0:1788843366.260310:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab7c18c000 for lustre-OST0000 00000001:00100000:0.0:1788843366.771485:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 57dd4253-596f-4283-9b4c-1047ff1bcc24 00000020:00000080:0.0:1788843366.771494:0:7650:0:(genops.c:885:class_export_put()) final put ffff8dab77922800/57dd4253-596f-4283-9b4c-1047ff1bcc24 00000001:00100000:0.0:1788843366.771523:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b87c6d43-928f-4231-aaff-6c642a37da7f 00000020:00000080:0.0:1788843366.771694:0:7650:0:(genops.c:885:class_export_put()) final put ffff8dab6e6e3800/b87c6d43-928f-4231-aaff-6c642a37da7f 00000020:00000080:2.0:1788843366.771756:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab77922800/57dd4253-596f-4283-9b4c-1047ff1bcc24 for lustre-OST0001 00000020:00000080:2.0:1788843366.771811:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab6e6e3800/b87c6d43-928f-4231-aaff-6c642a37da7f for lustre-OST0001 00000020:00000080:2.0:1788843366.771831:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab77927000 for lustre-OST0001 00000020:00000080:2.0:1788843366.771838:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab6e6e1800 for lustre-OST0001 00010000:00010000:3.0:1788843366.981147:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843368.007831:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843368.082460:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843368.082503:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843368.082543:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843368.082585:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843368.082617:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775833344 00000100:00100000:1.0:1788843368.082626:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775833344 00000100:00100000:2.0:1788843368.082814:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775833216 00000100:00100000:2.0:1788843368.082819:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775833216 00000100:00100000:2.0:1788843368.082877:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775833472 00000100:00100000:2.0:1788843368.082881:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775833472 00000100:00100000:2.0:1788843368.082906:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:2.0:1788843368.082918:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+12:2356:x1875737775833216:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843368.083012:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+12:2356:x1875737775833216:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 87us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843368.083019:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:2.0:1788843368.083038:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:2.0:1788843368.083045:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:2356:x1875737775833472:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843368.083070:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:2356:x1875737775833472:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 26us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843368.083075:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:3.0:1788843368.083300:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775833088 00000100:00100000:3.0:1788843368.083304:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775833088 00000100:00100000:3.0:1788843368.083381:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 128 00000100:00100000:3.0:1788843368.083389:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80593374-1a93-4bf4-84d9-50ccd339dd04+13:2356:x1875737775833088:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843368.083419:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80593374-1a93-4bf4-84d9-50ccd339dd04+13:2356:x1875737775833088:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 31us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843368.083440:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 128 00000100:00100000:1.0:1788843368.084038:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:1.0:1788843368.084050:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6f9f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2356:x1875737775833344:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843368.084096:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6f9f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2356:x1875737775833344:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 51us (1511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843368.084104:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00080000:1.0:1788843368.092800:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843368.092811:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788843369.032401:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843370.054331:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843370.310623:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6eb29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795736320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843370.310733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843370.310842:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795736320 00000100:00100000:3.0:1788843370.310852:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795736320 00000100:00100000:3.0:1788843370.310928:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788843370.310949:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795736320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843370.311002:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 68091904 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788843370.311059:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795736320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843370.311067:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788843370.311092:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843370.311139:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6eb29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795736320:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788843371.076630:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843371.333691:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843371.333721:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6eb29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795736448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843371.333813:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843371.333888:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795736448 00000100:00100000:3.0:1788843371.333897:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795736448 00000100:00100000:3.0:1788843371.333968:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788843371.333979:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795736448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843371.334022:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788843371.334072:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795736448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843371.334080:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788843371.334103:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843371.334166:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6eb29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795736448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843371.334257:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795736704:0@lo:400:kworker.0 00000100:00100000:3.0:1788843371.334284:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843371.334303:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788843371.334308:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6eb29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:845ba2f4-9198-464f-ba29-11072ff30647:3305:1875737795736576:0@lo:400:kworker.0 00000100:00100000:3.0:1788843371.334333:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843371.334390:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795737088:0@lo:400:kworker.0 00000100:00100000:3.0:1788843371.334417:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843371.334444:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795736704 00000100:00100000:3.0:1788843371.334448:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795736704 00000100:00100000:3.0:1788843371.334479:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788843371.334485:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795736704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843371.334520:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795736704:12345-0@lo:400:kworker.0 Request processed in 36us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843371.334527:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788843371.334552:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795736704:0@lo:400:kworker.0 00000100:00100000:3.0:1788843371.334567:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795736832:0@lo:400:kworker.0 00000100:00100000:3.0:1788843371.334587:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843371.334602:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843371.334607:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795736960:0@lo:400:kworker.0 00000100:00100000:3.0:1788843371.334628:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843371.334863:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795736576 00000100:00100000:2.0:1788843371.334868:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795736576 00000100:00100000:2.0:1788843371.334906:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788843371.334914:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+19:3305:x1875737795736576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843371.334971:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+19:3305:x1875737795736576:12345-0@lo:400:kworker.0 Request processed in 58us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843371.334986:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788843371.335021:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795737088 00000100:00100000:2.0:1788843371.335025:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795737088 00000100:00100000:2.0:1788843371.335058:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795736832 00000100:00100000:2.0:1788843371.335061:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795736832 00000100:00100000:2.0:1788843371.335071:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795736960 00000100:00100000:2.0:1788843371.335073:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795736960 00000100:00100000:2.0:1788843371.335087:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788843371.335093:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875737795737088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843371.335123:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875737795737088:12345-0@lo:400:kworker.0 Request processed in 30us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843371.335140:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788843371.335151:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788843371.335156:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795736832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843371.335187:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795736832:12345-0@lo:400:kworker.0 Request processed in 31us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843371.335193:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788843371.335205:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788843371.335211:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795736960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843371.335236:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795736960:12345-0@lo:400:kworker.0 Request processed in 26us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843371.335242:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788843371.335267:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843371.335282:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6eb29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:845ba2f4-9198-464f-ba29-11072ff30647:3305:1875737795736576:0@lo:400:kworker.0 00000100:00100000:2.0:1788843371.335292:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795737088:0@lo:400:kworker.0 00000100:00100000:2.0:1788843371.335327:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795736960:0@lo:400:kworker.0 00000100:00100000:2.0:1788843371.335336:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795736832:0@lo:400:kworker.0 00000040:00080000:3.0:1788843371.908807:0:14455:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788843371.908821:0:14455:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788843371.908862:0:14455:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788843371.908868:0:14455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788843372.100842:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788843372.713546:0:17369:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 00:56:11 (1788843371) 00010000:00010000:3.0:1788843373.124617:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843373.204178:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843373.204232:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843373.204257:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843373.204289:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843373.204324:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775833728 00000100:00100000:1.0:1788843373.204361:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775833728 00000100:00100000:1.0:1788843373.204424:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775833984 00000100:00100000:1.0:1788843373.204428:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775833984 00000100:00100000:1.0:1788843373.204454:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:1.0:1788843373.204465:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+12:2357:x1875737775833728:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843373.204537:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+12:2357:x1875737775833728:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 74us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843373.204546:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:1.0:1788843373.204563:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:1.0:1788843373.204571:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:2357:x1875737775833984:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843373.204598:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:2357:x1875737775833984:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843373.204605:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00080000:1.0:1788843373.204625:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843373.205001:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775833600 00000100:00100000:3.0:1788843373.205007:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775833600 00000100:00100000:3.0:1788843373.205047:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 130 00000100:00100000:3.0:1788843373.205055:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+13:2357:x1875737775833600:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843373.205087:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+13:2357:x1875737775833600:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 33us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843373.205093:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 130 00000100:00100000:3.0:1788843373.205123:0:16114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775833856 00000100:00100000:3.0:1788843373.205126:0:16114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775833856 00000100:00100000:3.0:1788843373.205171:0:16114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:3.0:1788843373.205179:0:16114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2357:x1875737775833856:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843373.205208:0:16114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2357:x1875737775833856:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 30us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843373.205214:0:16114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00080000:1.0:1788843373.208261:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788843374.148549:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843375.172715:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843375.428770:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795737216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843375.428877:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843375.428945:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795737216 00000100:00100000:3.0:1788843375.428957:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795737216 00000100:00100000:3.0:1788843375.429045:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788843375.429058:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795737216:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788843375.429061:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788843375.429106:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 68091904 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788843375.429176:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795737216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843375.429184:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788843375.429223:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795737216:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788843376.199308:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843376.201413:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843376.201599:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775834240 00000100:00100000:2.0:1788843376.201613:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775834240 00000100:00100000:2.0:1788843376.201702:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:2.0:1788843376.201716:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+12:15314:x1875737775834240:12345-192.168.203.29@tcp:35:umount.0 00000001:00080000:2.0:1788843376.202149:0:14423:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1788843376.202272:0:14423:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:2.0:1788843376.202477:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+15:15314:x1875737775834240:12345-192.168.203.29@tcp:35:umount.0 Request processed in 762us (1074us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1788843376.202486:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000020:00080000:2.0:1788843376.202492:0:14423:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:0.0:1788843376.202654:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843376.210877:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843376.210934:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843376.210985:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843376.211099:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775834368 00000100:00100000:1.0:1788843376.211110:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775834368 00000100:00100000:1.0:1788843376.211157:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775834496 00000100:00100000:1.0:1788843376.211161:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775834496 00000100:00100000:1.0:1788843376.211184:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775834624 00000100:00100000:1.0:1788843376.211187:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775834624 00000100:00100000:1.0:1788843376.211203:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:1.0:1788843376.211214:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80593374-1a93-4bf4-84d9-50ccd339dd04+15:2359:x1875737775834368:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843376.211229:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843376.211250:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7799e000/0xc6b8ac1b091606b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c0e expref: 15 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843376.211270:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843376.211385:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80593374-1a93-4bf4-84d9-50ccd339dd04+14:2359:x1875737775834368:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 129us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843376.211393:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:1.0:1788843376.211412:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:1.0:1788843376.211419:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6002f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80593374-1a93-4bf4-84d9-50ccd339dd04+13:2358:x1875737775834496:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843376.211427:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843376.211437:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8daa42697200/0xc6b8ac1b0916072 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c38 expref: 13 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843376.211445:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843376.211474:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6002f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80593374-1a93-4bf4-84d9-50ccd339dd04+12:2358:x1875737775834496:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 46us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843376.211481:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:1.0:1788843376.211521:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:1.0:1788843376.211528:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80593374-1a93-4bf4-84d9-50ccd339dd04+11:2358:x1875737775834624:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843376.211536:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843376.211545:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0916113 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084cd9 expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843376.211562:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843376.211581:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80593374-1a93-4bf4-84d9-50ccd339dd04+10:2358:x1875737775834624:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 53us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843376.211587:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:1.0:1788843376.215330:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843376.215547:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775834752 00000100:00100000:3.0:1788843376.215558:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775834752 00000100:00100000:3.0:1788843376.215638:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:3.0:1788843376.215653:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2355:x1875737775834752:12345-192.168.203.29@tcp:9:umount.0 00000100:00080000:0.0:1788843376.215670:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1788843376.215694:0:15105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0916087 00000100:00080000:3.0:1788843376.215706:0:15105:0:(import.c:65:import_set_state_nolock()) ffff8dab77927800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788843376.215750:0:15105:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:3.0:1788843376.216055:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+2:2355:x1875737775834752:12345-192.168.203.29@tcp:9:umount.0 Request processed in 406us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843376.216063:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00010000:00010000:0.0:1788843376.219004:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843376.223045:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843376.223129:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775835648 00000100:00100000:1.0:1788843376.223139:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775835648 00000100:00100000:1.0:1788843376.223205:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:1.0:1788843376.223217:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+15:2355:x1875737775835648:12345-192.168.203.29@tcp:39:umount.0 00000020:00000080:1.0:1788843376.223254:0:14420:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0916080 00000020:00010000:1.0:1788843376.223272:0:14420:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8daa4266b000: total 0 00000100:00080000:1.0:1788843376.223289:0:14420:0:(import.c:65:import_set_state_nolock()) ffff8dab6e6e0800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788843376.223323:0:14420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000020:00010000:3.0:1788843376.223556:0:14408:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8daa4266b000: total 0 00010000:00010000:3.0:1788843376.223561:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843376.223604:0:14408:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8daa4266b000, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1788843376.223637:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:3.0:1788843376.223640:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788843376.223649:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697800/0xc6b8ac1b0916208 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d1f expref: 14 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843376.223674:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dab54910b00) 00010000:00010000:3.0:1788843376.223677:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788843376.223681:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0916304 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d6c expref: 13 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843376.223698:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:3.0:1788843376.223701:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788843376.223705:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916286 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d49 expref: 12 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843376.223737:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:3.0:1788843376.223740:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843376.223745:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0916183 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084cf5 expref: 11 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843376.223758:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:3.0:1788843376.223761:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788843376.223764:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09162a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d57 expref: 10 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843376.223780:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dab43e63800) 00010000:00010000:3.0:1788843376.223782:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843376.223786:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091614b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ce7 expref: 9 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843376.223802:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dab50f54400) 00010000:00010000:3.0:1788843376.223804:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843376.223807:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b091612f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ce0 expref: 8 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843376.223822:0:14408:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8daa4266b000, canceled 7 locks, left on hash table 0. 00010000:00010000:3.0:1788843376.223835:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843376.223836:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843376.223838:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843376.225833:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+6:2355:x1875737775835648:12345-192.168.203.29@tcp:39:umount.0 Request processed in 1094us (1273us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1788843376.225851:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:2.0:1788843376.452943:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795737344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843376.452998:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795737728:0@lo:400:kworker.0 00000100:00100000:2.0:1788843376.453033:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843376.453116:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795737344 00000100:00100000:3.0:1788843376.453125:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795737344 00000100:00100000:3.0:1788843376.453185:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788843376.453211:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795737344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843376.453245:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843376.453381:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:845ba2f4-9198-464f-ba29-11072ff30647:3307:1875737795737472:0@lo:400:kworker.0 00000100:00100000:1.0:1788843376.457635:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843376.457745:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788843376.457761:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795737600:0@lo:400:kworker.0 00000100:00100000:1.0:1788843376.457824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843376.457844:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795738112:0@lo:400:kworker.0 00000100:00100000:1.0:1788843376.457873:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843376.457933:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795738112 00000100:00100000:1.0:1788843376.457943:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795738112 00000100:00100000:1.0:1788843376.458028:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788843376.458039:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875737795738112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843376.458109:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875737795738112:12345-0@lo:400:kworker.0 Request processed in 72us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843376.458116:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788843376.458173:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795738112:0@lo:400:kworker.0 00000100:00100000:3.0:1788843376.459432:0:16114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795737728 00000100:00100000:3.0:1788843376.459447:0:16114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795737728 00000100:00100000:3.0:1788843376.459587:0:16114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795737600 00000100:00100000:3.0:1788843376.459591:0:16114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795737600 00000100:00100000:3.0:1788843376.459621:0:16114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788843376.459635:0:16114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875737795737728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843376.459731:0:16114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875737795737728:12345-0@lo:400:kworker.0 Request processed in 101us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843376.459738:0:16114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788843376.459762:0:16114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788843376.459778:0:16114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795737600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843376.459811:0:16114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795737600:12345-0@lo:400:kworker.0 Request processed in 43us (1987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843376.459817:0:16114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788843376.462825:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843376.462835:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843376.462890:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795737600:0@lo:400:kworker.0 00000100:00100000:3.0:1788843376.462920:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795737728:0@lo:400:kworker.0 00000100:00100000:3.0:1788843376.463001:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795737344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9791us (9968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843376.463010:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788843376.463776:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843376.463815:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795737984:0@lo:400:kworker.0 00000100:00100000:0.0:1788843376.463853:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843376.463879:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795737984 00000100:00100000:0.0:1788843376.463886:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795737984 00000100:00100000:0.0:1788843376.463949:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788843376.463958:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795737984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843376.463971:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795737472 00000100:00100000:3.0:1788843376.463975:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795737472 00000100:00100000:0.0:1788843376.464000:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795737984:12345-0@lo:400:kworker.0 Request processed in 44us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843376.464002:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788843376.464007:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788843376.464008:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+19:3307:x1875737795737472:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788843376.464022:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843376.464042:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795737984:0@lo:400:kworker.0 00000100:00100000:3.0:1788843376.464048:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+19:3307:x1875737795737472:12345-0@lo:400:kworker.0 Request processed in 41us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843376.464054:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788843376.464061:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:845ba2f4-9198-464f-ba29-11072ff30647:3307:1875737795737472:0@lo:400:kworker.0 00000100:00100000:0.0:1788843376.464069:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843376.464074:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795737856:0@lo:400:kworker.0 00000100:00100000:0.0:1788843376.464104:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843376.464370:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795737856 00000100:00100000:3.0:1788843376.464375:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795737856 00000100:00100000:3.0:1788843376.464583:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788843376.464591:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795737856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843376.464632:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795737856:12345-0@lo:400:kworker.0 Request processed in 42us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843376.464638:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788843376.468458:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795737344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843376.470751:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795737856:0@lo:400:kworker.0 00000001:00100000:3.0:1788843376.530325:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b87c6d43-928f-4231-aaff-6c642a37da7f 00000020:00000080:3.0:1788843376.530375:0:6719:0:(genops.c:885:class_export_put()) final put ffff8dab77926000/b87c6d43-928f-4231-aaff-6c642a37da7f 00000020:00000080:0.0:1788843376.530698:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab77926000/b87c6d43-928f-4231-aaff-6c642a37da7f for lustre-OST0000 00000020:00000080:0.0:1788843376.530768:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab77927800 for lustre-OST0000 00010000:00010000:0.0:1788843377.221200:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843377.991753:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843377.991843:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843377.992048:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843377.992072:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775835904 00000100:00100000:3.0:1788843377.992081:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775835904 00000100:00100000:3.0:1788843377.992151:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775835776 00000100:00100000:3.0:1788843377.992154:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775835776 00000100:00100000:3.0:1788843377.992173:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:3.0:1788843377.992184:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80593374-1a93-4bf4-84d9-50ccd339dd04+11:2359:x1875737775835904:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843377.992200:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843377.992221:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab49375000/0xc6b8ac1b09160aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c9a expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843377.994319:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843377.994484:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80593374-1a93-4bf4-84d9-50ccd339dd04+10:2359:x1875737775835904:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 2291us (2730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843377.994502:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:3.0:1788843377.994556:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:3.0:1788843377.994593:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80593374-1a93-4bf4-84d9-50ccd339dd04+9:2359:x1875737775835776:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843377.994617:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843377.994650:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab4933ae00/0xc6b8ac1b09160a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c70 expref: 9 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843377.994667:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843377.994710:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80593374-1a93-4bf4-84d9-50ccd339dd04+8:2359:x1875737775835776:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 124us (2868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843377.994717:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1788843378.006194:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843378.006310:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775836288 00000100:00100000:3.0:1788843378.006328:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775836288 00000100:00100000:3.0:1788843378.006502:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:3.0:1788843378.006516:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:2355:x1875737775836288:12345-192.168.203.29@tcp:39:umount.0 00000020:00000080:3.0:1788843378.006573:0:15380:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b09160b8 00000020:00010000:3.0:1788843378.006584:0:15380:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8daa42669800: total 0 00000100:00080000:3.0:1788843378.006590:0:15380:0:(import.c:65:import_set_state_nolock()) ffff8daa4266e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788843378.006617:0:15380:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:3.0:1788843378.006938:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57dd4253-596f-4283-9b4c-1047ff1bcc24+5:2355:x1875737775836288:12345-192.168.203.29@tcp:39:umount.0 Request processed in 424us (753us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1788843378.006949:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 56 00000020:00010000:3.0:1788843378.007010:0:14408:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8daa42669800: total 0 00010000:00010000:3.0:1788843378.007062:0:14408:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8daa42669800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788843378.007105:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:3.0:1788843378.007109:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843378.007120:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916191 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084cfc expref: 4 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843378.007545:0:14408:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8daa42669800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788843378.007563:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843378.007566:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843378.007568:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788843378.007886:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843378.016012:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775836032 00000100:00100000:0.0:1788843378.016027:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775836032 00000100:00100000:0.0:1788843378.016106:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:0.0:1788843378.016116:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80593374-1a93-4bf4-84d9-50ccd339dd04+8:2359:x1875737775836032:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843378.016132:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843378.016156:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab49375e00/0xc6b8ac1b091610c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084cd2 expref: 8 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843378.016174:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843378.016236:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80593374-1a93-4bf4-84d9-50ccd339dd04+7:2359:x1875737775836032:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 122us (24188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843378.016243:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:2.0:1788843378.035648:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843378.035751:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775836544 00000100:00100000:0.0:1788843378.035761:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775836544 00000100:00100000:0.0:1788843378.035812:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 132 00000100:00100000:0.0:1788843378.035822:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+7:2355:x1875737775836544:12345-192.168.203.29@tcp:251:umount.0 00000020:00000080:0.0:1788843378.035872:0:14413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b091605d 00000020:00010000:0.0:1788843378.035881:0:14413:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dab441fe000: total 0 00000100:00080000:0.0:1788843378.035885:0:14413:0:(import.c:65:import_set_state_nolock()) ffff8dab441ff000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788843378.035969:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+3:2355:x1875737775836544:12345-192.168.203.29@tcp:251:umount.0 Request processed in 148us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843378.035977:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 132 00000020:00010000:1.0:1788843378.036025:0:14409:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dab441fe000: total 0 00010000:00010000:1.0:1788843378.036036:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843378.036108:0:14409:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dab441fe000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788843378.036155:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0916064 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c07 expref: 2 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843378.036245:0:14409:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dab441fe000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788843378.036262:0:14409:0:(genops.c:885:class_export_put()) final put ffff8dab441fe000/80593374-1a93-4bf4-84d9-50ccd339dd04 00010000:00010000:1.0:1788843378.036942:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843378.036946:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843378.036949:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788843378.037002:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab441fe000/80593374-1a93-4bf4-84d9-50ccd339dd04 for MGS 00000020:00000080:3.0:1788843378.037055:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab441ff000 for MGS 00010000:00010000:0.0:1788843378.244945:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843379.269551:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788843379.959276:0:17565:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788843379.976573:0:17565:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788843379.976652:0:17565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933be00/0xc6b8ac1b0915d8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915d93 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843379.976670:0:17565:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933be00/0xc6b8ac1b0915d8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915d93 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843379.976679:0:17565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933be00/0xc6b8ac1b0915d8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0915d93 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843379.976687:0:17565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab4933be00/0xc6b8ac1b0915d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0915d93 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843379.976714:0:17565:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788843379.976720:0:17565:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788843379.976763:0:17565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788843379.976769:0:17565:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788843379.976777:0:17565:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788843379.976811:0:17565:0:(import.c:65:import_set_state_nolock()) ffff8dab6e2c6800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788843379.977202:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843379.977213:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab4933be00/0xc6b8ac1b0915d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0915d93 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.977222:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933be00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843379.977227:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933be00/0xc6b8ac1b0915d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0915d93 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.977238:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab4933be00/0xc6b8ac1b0915d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0915d93 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843379.977245:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933be00/0xc6b8ac1b0915d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0915d93 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843379.977252:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788843379.977255:0:14408:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788843379.977258:0:14408:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788843379.977291:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab4933be00/0xc6b8ac1b0915d8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0915d93 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.977297:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843379.977326:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab4933be00/0xc6b8ac1b0915d8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0915d93 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.977385:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab4933be00/0xc6b8ac1b0915d8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0915d93 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.977400:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843379.977402:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843379.977404:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843379.977470:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843379.977495:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:845ba2f4-9198-464f-ba29-11072ff30647:3304:1875737795738368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843379.977585:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843379.977844:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795738368 00000100:00100000:3.0:1788843379.977853:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795738368 00000100:00100000:3.0:1788843379.977931:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788843379.977942:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:845ba2f4-9198-464f-ba29-11072ff30647+19:3304:x1875737795738368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843379.977959:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843379.977981:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab4933b400/0xc6b8ac1b0915d93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0915d8c expref: 19 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.977997:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843379.978064:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:845ba2f4-9198-464f-ba29-11072ff30647+18:3304:x1875737795738368:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843379.978073:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788843379.978202:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875737795738240:0@lo:39:umount.0 00000100:00100000:1.0:1788843379.978245:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843379.978328:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795738240 00000100:00100000:2.0:1788843379.978334:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795738240 00000100:00100000:2.0:1788843379.978404:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788843379.978412:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875737795738240:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788843379.978529:0:14421:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915dbd 00000100:00080000:2.0:1788843379.978541:0:14421:0:(import.c:65:import_set_state_nolock()) ffff8dab6ec51000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788843379.978615:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3303:x1875737795738240:12345-0@lo:39:umount.0 Request processed in 203us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843379.978622:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000020:00000080:2.0:1788843379.978632:0:14421:0:(genops.c:885:class_export_put()) final put ffff8dab6ec57800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1788843379.978679:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab6e2c6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788843379.978691:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875737795738240:0@lo:39:umount.0 00010000:00010000:1.0:1788843379.978835:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843379.978929:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:845ba2f4-9198-464f-ba29-11072ff30647:3304:1875737795738368:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788843379.978961:0:17565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788843379.978964:0:17565:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788843379.978970:0:17565:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788843379.979893:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab6ec57800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788843379.979973:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab6ec51000 for lustre-MDT0000 00010000:00010000:0.0:1788843379.981020:0:17565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a000/0xc6b8ac1b0915cf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915cf9 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843379.981060:0:17565:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a000/0xc6b8ac1b0915cf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915cf9 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843379.981069:0:17565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a000/0xc6b8ac1b0915cf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0915cf9 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843379.981075:0:17565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab4933a000/0xc6b8ac1b0915cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0915cf9 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843379.981100:0:17565:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843379.981107:0:17565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab49375800/0xc6b8ac1b0915f84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915f8b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843379.981113:0:17565:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab49375800/0xc6b8ac1b0915f84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915f8b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843379.981119:0:17565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab49375800/0xc6b8ac1b0915f84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0915f8b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843379.981125:0:17565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab49375800/0xc6b8ac1b0915f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0915f8b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843379.981140:0:17565:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788843379.981147:0:17565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933ac00/0xc6b8ac1b09160fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916105 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843379.981154:0:17565:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933ac00/0xc6b8ac1b09160fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0916105 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843379.981169:0:17565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933ac00/0xc6b8ac1b09160fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0916105 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843379.981176:0:17565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab4933ac00/0xc6b8ac1b09160fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0916105 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843379.981183:0:17565:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788843379.981188:0:17565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0915ce4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915ceb expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843379.981194:0:17565:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0915ce4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915ceb expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843379.981200:0:17565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0915ce4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0915ceb expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843379.981206:0:17565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0915ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0915ceb expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843379.981214:0:17565:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788843379.981217:0:17565:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788843379.981248:0:17565:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788843379.981252:0:17565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788843379.981257:0:17565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843379.981263:0:17565:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:0.0:1788843379.981270:0:17565:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8daa42668000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788843379.981277:0:17565:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dab441f9800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788843379.981285:0:17565:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8daa42669800 57dd4253-596f-4283-9b4c-1047ff1bcc24 192.168.203.29@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1788843379.981295:0:17565:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8daa4266b000 b87c6d43-928f-4231-aaff-6c642a37da7f 192.168.203.29@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:0.0:1788843379.981301:0:17565:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8dab600719b8) has exports, disconnecting them 00000020:00080000:0.0:1788843379.981306:0:17565:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8daa42668000), last request at 1788843376 00000020:00000080:0.0:1788843379.981313:0:17565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915f76 00000100:00080000:0.0:1788843379.981373:0:17565:0:(import.c:65:import_set_state_nolock()) ffff8daa4266c800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788843379.981431:0:17565:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8daa42668000): rc 0 00000020:00000080:0.0:1788843379.981433:0:17565:0:(genops.c:885:class_export_put()) final put ffff8daa42668000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1788843379.981752:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788843379.981763:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab4933a000/0xc6b8ac1b0915cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0915cf9 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.981771:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933a000 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843379.981776:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933a000/0xc6b8ac1b0915cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0915cf9 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.981801:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab4933a000/0xc6b8ac1b0915cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0915cf9 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843379.981809:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933a000/0xc6b8ac1b0915cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0915cf9 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843379.981815:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788843379.981818:0:14408:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1788843379.981820:0:14408:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1788843379.981865:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab4933a000/0xc6b8ac1b0915cf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0915cf9 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.981873:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843379.981911:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab4933a000/0xc6b8ac1b0915cf2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0915cf9 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.981919:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab4933a000/0xc6b8ac1b0915cf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0915cf9 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.981933:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788843379.981937:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab49375800/0xc6b8ac1b0915f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0915f8b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.981943:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375800 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843379.981946:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab49375800/0xc6b8ac1b0915f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0915f8b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.981953:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab49375800/0xc6b8ac1b0915f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0915f8b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843379.981970:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab49375800/0xc6b8ac1b0915f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0915f8b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843379.981976:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788843379.981978:0:14408:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788843379.981980:0:14408:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788843379.981995:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab49375800/0xc6b8ac1b0915f84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0915f8b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.982001:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843379.982007:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab49375800/0xc6b8ac1b0915f84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0915f8b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.982014:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab49375800/0xc6b8ac1b0915f84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0915f8b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.982029:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788843379.982033:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab4933ac00/0xc6b8ac1b09160fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0916105 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.982039:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933ac00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843379.982042:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933ac00/0xc6b8ac1b09160fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0916105 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.982048:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab4933ac00/0xc6b8ac1b09160fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0916105 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843379.982055:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933ac00/0xc6b8ac1b09160fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0916105 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843379.982071:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788843379.982073:0:14408:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788843379.982075:0:14408:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788843379.982091:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab4933ac00/0xc6b8ac1b09160fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0916105 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.982098:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843379.982119:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab4933ac00/0xc6b8ac1b09160fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0916105 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.982126:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab4933ac00/0xc6b8ac1b09160fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0916105 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.982136:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843379.982140:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0915ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0915ceb expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.982146:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b800 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843379.982149:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0915ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0915ceb expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.982156:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0915ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0915ceb expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843379.982163:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0915ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0915ceb expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843379.982170:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788843379.982172:0:14408:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788843379.982174:0:14408:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788843379.982195:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0915ce4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0915ceb expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.982202:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843379.982208:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0915ce4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0915ceb expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.982215:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0915ce4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0915ceb expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.982230:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843379.982232:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843379.982234:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843379.982257:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:845ba2f4-9198-464f-ba29-11072ff30647:3304:1875737795738752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843379.982367:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843379.982432:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843379.982451:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:845ba2f4-9198-464f-ba29-11072ff30647:3304:1875737795738880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843379.982476:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843379.982510:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795738752 00000100:00100000:3.0:1788843379.982519:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795738752 00000100:00100000:3.0:1788843379.982570:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795738880 00000100:00100000:3.0:1788843379.982573:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795738880 00000100:00100000:3.0:1788843379.982591:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788843379.982601:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:845ba2f4-9198-464f-ba29-11072ff30647+19:3304:x1875737795738752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843379.982616:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843379.982633:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab4933b000/0xc6b8ac1b0916105 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b09160fe expref: 19 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.982646:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843379.982686:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:845ba2f4-9198-464f-ba29-11072ff30647+18:3304:x1875737795738752:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843379.982701:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788843379.982720:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788843379.982726:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6002f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:845ba2f4-9198-464f-ba29-11072ff30647+17:3304:x1875737795738880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843379.982735:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843379.982749:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7799f800/0xc6b8ac1b0915ceb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0915ce4 expref: 17 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843379.982760:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843379.982784:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6002f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:845ba2f4-9198-464f-ba29-11072ff30647+16:3304:x1875737795738880:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843379.982789:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788843379.982860:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:845ba2f4-9198-464f-ba29-11072ff30647:3304:1875737795738880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843379.982869:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:845ba2f4-9198-464f-ba29-11072ff30647:3304:1875737795738752:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788843379.982981:0:17565:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dab441f9800), last request at 1788843376 00000020:00000080:0.0:1788843379.982991:0:17565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915e42 00000100:00080000:0.0:1788843379.983003:0:17565:0:(import.c:65:import_set_state_nolock()) ffff8dab441fb800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788843379.983033:0:17565:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dab441f9800): rc 0 00000020:00000080:0.0:1788843379.983036:0:17565:0:(genops.c:885:class_export_put()) final put ffff8dab441f9800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1788843379.983153:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843379.983211:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788843379.983364:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8daa42668000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788843379.983424:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8daa4266c800 for lustre-MDT0000 00000100:00100000:2.0:1788843379.983573:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795738496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843379.983624:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843379.983673:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843379.983679:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795738624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843379.983702:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843379.983791:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795738496 00000100:00100000:1.0:1788843379.983799:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795738496 00000100:00100000:1.0:1788843379.983847:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795738624 00000100:00100000:1.0:1788843379.983850:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795738624 00000100:00100000:1.0:1788843379.983868:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788843379.983887:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:845ba2f4-9198-464f-ba29-11072ff30647+17:3306:x1875737795738496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843379.983911:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843379.983926:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7799ea00/0xc6b8ac1b0915cf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0915cf2 expref: 17 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843379.983940:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843379.983977:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:845ba2f4-9198-464f-ba29-11072ff30647+16:3306:x1875737795738496:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843379.983985:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788843379.984001:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788843379.984007:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:845ba2f4-9198-464f-ba29-11072ff30647+15:3306:x1875737795738624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843379.984015:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843379.984023:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7799fc00/0xc6b8ac1b0915f8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0915f84 expref: 15 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843379.984037:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843379.984058:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:845ba2f4-9198-464f-ba29-11072ff30647+14:3306:x1875737795738624:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843379.984069:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00000080:0.0:1788843379.984162:0:17565:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa9b2c1cc3ae0 00000100:00080000:0.0:1788843379.984194:0:17565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788843379.984199:0:17565:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 3 00000004:00080000:0.0:1788843379.984254:0:17565:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788843379.984323:0:17565:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788843379.984367:0:17565:0:(import.c:65:import_set_state_nolock()) ffff8dab50397800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788843379.984384:0:17565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788843379.984386:0:17565:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1788843379.984394:0:17565:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788843379.984451:0:17565:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788843379.984460:0:17565:0:(import.c:65:import_set_state_nolock()) ffff8dab48813000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788843379.984496:0:17565:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8dab600719b8) has no exports 00000100:00100000:2.0:1788843379.984985:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795738624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843379.984997:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795738496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843379.985028:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795739008:0@lo:9:umount.0 00000100:00100000:2.0:1788843379.985082:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843379.985124:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795739136:0@lo:9:umount.0 00000100:00100000:2.0:1788843379.985148:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788843379.985192:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab441f9800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788843379.985241:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab441fb800 for lustre-MDT0000 00000100:00100000:1.0:1788843379.985315:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795739008 00000100:00100000:1.0:1788843379.985321:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795739008 00000100:00100000:1.0:1788843379.985406:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795739136 00000100:00100000:1.0:1788843379.985409:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795739136 00000100:00100000:1.0:1788843379.985431:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788843379.985440:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875737795739008:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788843379.985469:0:15107:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915e5e 00000100:00080000:1.0:1788843379.985479:0:15107:0:(import.c:65:import_set_state_nolock()) ffff8dab441fc000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788843379.985522:0:15107:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:1.0:1788843379.985971:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3303:x1875737795739008:12345-0@lo:9:umount.0 Request processed in 531us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843379.985994:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788843379.986017:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788843379.986024:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875737795739136:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788843379.986042:0:15107:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915f92 00000100:00080000:1.0:1788843379.986049:0:15107:0:(import.c:65:import_set_state_nolock()) ffff8dab6e6e5800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788843379.986076:0:15107:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1788843379.986282:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3303:x1875737795739136:12345-0@lo:9:umount.0 Request processed in 256us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843379.986289:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1788843379.986315:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788843379.986399:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788843379.986412:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788843379.986452:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab50397800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788843379.986470:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788843379.986473:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788843379.986477:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795739008:0@lo:9:umount.0 00000100:00080000:2.0:1788843379.986490:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab48813000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788843379.986500:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788843379.986502:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788843379.986504:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795739136:0@lo:9:umount.0 00010000:00010000:3.0:1788843379.987247:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788843380.001451:0:17565:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8dab600719b8) has no exports 00000020:00000080:1.0:1788843380.073839:0:17565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915d3f 00000020:00000080:1.0:1788843380.073856:0:17565:0:(genops.c:885:class_export_put()) final put ffff8dab699d2800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788843380.073883:0:17565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788843380.074685:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab699d2800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788843380.078451:0:17565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843380.078468:0:17565:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788843380.078474:0:17565:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8dab77ac3370) has no exports 00000020:00000080:1.0:1788843380.082658:0:17565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915d38 00000020:00000080:1.0:1788843380.082677:0:17565:0:(genops.c:885:class_export_put()) final put ffff8dab50396000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788843380.082784:0:17565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843380.082799:0:17565:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788843380.082803:0:17565:0:(genops.c:885:class_export_put()) final put ffff8dab7395f000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788843380.082807:0:17565:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7395f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788843380.082820:0:17565:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788843380.083535:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab50396000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788843380.294800:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788843381.121206:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b87c6d43-928f-4231-aaff-6c642a37da7f 00000001:00080000:2.0:1788843381.121226:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:2.0:1788843381.121242:0:5868:0:(genops.c:885:class_export_put()) final put ffff8daa4266b000/b87c6d43-928f-4231-aaff-6c642a37da7f 00000001:00100000:2.0:1788843381.121268:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 57dd4253-596f-4283-9b4c-1047ff1bcc24 00000001:00080000:2.0:1788843381.121276:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:2.0:1788843381.121287:0:5868:0:(genops.c:885:class_export_put()) final put ffff8daa42669800/57dd4253-596f-4283-9b4c-1047ff1bcc24 00000020:00000080:0.0:1788843381.121393:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8daa4266b000/b87c6d43-928f-4231-aaff-6c642a37da7f for lustre-MDT0000 00000020:00000080:0.0:1788843381.121549:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8daa42669800/57dd4253-596f-4283-9b4c-1047ff1bcc24 for lustre-MDT0000 00000020:00000080:0.0:1788843381.121578:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab6e6e0800 for lustre-MDT0000 00000020:00000080:0.0:1788843381.121583:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8daa4266e000 for lustre-MDT0000 00010000:00010000:3.0:1788843381.316766:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843381.574098:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795739392:0@lo:400:kworker.0 00000100:00100000:1.0:1788843381.574130:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795739264:0@lo:400:kworker.0 00000100:00100000:2.0:1788843381.574163:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843381.574175:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843381.574250:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875737795739520:0@lo:400:kworker.0 00000100:00100000:3.0:1788843381.574280:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843381.574317:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795739392 00000100:00100000:3.0:1788843381.574324:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795739392 00000100:00100000:3.0:1788843381.574377:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795739520 00000100:00100000:3.0:1788843381.574381:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795739520 00000100:00100000:3.0:1788843381.574713:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788843381.574721:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3307:x1875737795739392:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788843381.574744:0:15380:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788843381.574788:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3307:x1875737795739392:12345-0@lo:400:kworker.0 Request processed in 65us (623us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788843381.574795:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788843381.574813:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788843381.574817:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3304:x1875737795739520:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788843381.574822:0:15380:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788843381.574844:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3304:x1875737795739520:12345-0@lo:400:kworker.0 Request processed in 25us (564us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788843381.574850:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1788843381.578133:0:3304:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788843381.578428:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dab7f6e3000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788843381.578433:0:3304:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788843381.580066:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795739264 00000100:00100000:2.0:1788843381.580078:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795739264 00000100:00100000:2.0:1788843381.580134:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788843381.580144:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+14:3306:x1875737795739264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843381.580240:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+14:3306:x1875737795739264:12345-0@lo:400:kworker.0 Request processed in 97us (6063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843381.580249:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1788843381.580285:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788843381.580291:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8dab48b91800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788843381.580295:0:3307:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788843381.580300:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8dab48b91800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788843381.580305:0:3307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 440 00000100:00080000:0.0:1788843381.580311:0:3307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dab48b91800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1788843381.580326:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795739264:0@lo:400:kworker.0 00000100:00100000:0.0:1788843381.580353:0:3307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab7cd40700 x1875737795739648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843381.580378:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795739392:0@lo:400:kworker.0 00000100:00100000:1.0:1788843381.580500:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875737795739648:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788843381.580556:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843381.580704:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795739648 00000100:00100000:2.0:1788843381.580710:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795739648 00000100:00100000:2.0:1788843381.580754:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788843381.580760:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875737795739648:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788843381.580775:0:14420:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1788843381.598408:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dab7f6e3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843381.598419:0:3304:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 454 00000100:00080000:3.0:1788843381.598429:0:3304:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dab7f6e3000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1788843381.598471:0:3304:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab43782300 x1875737795739776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788843381.598495:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875737795739520:0@lo:400:kworker.0 00000100:00100000:1.0:1788843381.598570:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875737795739776:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788843381.598654:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843381.606478:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795739776 00000100:00100000:3.0:1788843381.606491:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795739776 00000100:00100000:3.0:1788843381.606545:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788843381.606554:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875737795739776:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788843381.606571:0:14422:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788843381.606658:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875737795739776:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 104us (8003us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788843381.606681:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1788843381.614455:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab7f6e3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788843381.614471:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788843381.614478:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875737795739776:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788843381.624748:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875737795739648:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 43979us (44185us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788843381.624761:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788843381.624833:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab48b91800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843381.624838:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788843381.624843:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875737795739648:0@lo:38:ptlrpcd_00_03.0 00000001:00100000:3.0:1788843381.656082:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788843381.656091:0:6719:0:(genops.c:885:class_export_put()) final put ffff8dab441fa800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788843381.656212:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab441fa800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788843381.656261:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab441fc000 for lustre-OST0000 00000001:00100000:0.0:1788843382.145982:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788843382.145992:0:7650:0:(genops.c:885:class_export_put()) final put ffff8dab6e6e6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788843382.146173:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab6e6e6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788843382.146227:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab6e6e5800 for lustre-OST0001 00000020:01000000:0.0:1788843382.150149:0:17565:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dab7fc0ea80 - data ffff8dab5f70a288/ffff8dab73d90400 00000020:01000000:0.0:1788843382.150300:0:17565:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dab514a9540 - data ffff8dab5f7a2ca8/ffff8dab6f8e0c00 00000001:00000004:0.0:1788843382.159626:0:17565:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:2.0:1788843382.250077:0:17565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788843382.250086:0:17565:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 4 00000004:00080000:2.0:1788843382.250110:0:17565:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788843382.250113:0:17565:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788843382.250831:0:14442:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788843382.250838:0:14442:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:0.0:1788843382.250848:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788843382.251983:0:17565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788843382.251989:0:17565:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788843382.252010:0:17565:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788843382.252012:0:17565:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788843382.252380:0:14444:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788843382.252385:0:14444:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:0.0:1788843382.252393:0:14444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788843382.297442:0:17565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915d07 00000020:00000080:1.0:1788843382.297457:0:17565:0:(genops.c:885:class_export_put()) final put ffff8dab48816800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788843382.297722:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab48816800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788843382.298721:0:17565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915d1c 00000020:00000080:1.0:1788843382.298732:0:17565:0:(genops.c:885:class_export_put()) final put ffff8dab71a20000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788843382.298791:0:17565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788843382.298797:0:17565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843382.298805:0:17565:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788843382.298810:0:17565:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8dab60070000) has no exports 00000004:01000000:1.0:1788843382.298979:0:17565:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788843382.298987:0:17565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915d69 00000020:00000080:1.0:1788843382.298991:0:17565:0:(genops.c:885:class_export_put()) final put ffff8dab440c6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788843382.299436:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab71a20000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788843382.299499:0:17565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788843382.299504:0:17565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843382.299510:0:17565:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788843382.299514:0:17565:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8dab6f870000) has no exports 00000020:00000080:1.0:1788843382.299521:0:17565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915d62 00000020:00000080:1.0:1788843382.299525:0:17565:0:(genops.c:885:class_export_put()) final put ffff8dab48817000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788843382.299890:0:17565:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788843382.299895:0:17565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788843382.299899:0:17565:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788843382.299904:0:17565:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788843382.299907:0:17565:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788843382.299937:0:17565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843382.299942:0:17565:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788843382.299948:0:17565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915d54 00000020:00000080:1.0:1788843382.299952:0:17565:0:(genops.c:885:class_export_put()) final put ffff8dab50677000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788843382.299956:0:17565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788843382.299960:0:17565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843382.299963:0:17565:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788843382.299965:0:17565:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8dab77ac4d28) has no exports 00000020:00000080:1.0:1788843382.299970:0:17565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915d4d 00000020:00000080:1.0:1788843382.299982:0:17565:0:(genops.c:885:class_export_put()) final put ffff8dab5436e800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788843382.300385:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab440c6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788843382.300395:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab48817000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788843382.300401:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab48813000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788843382.300408:0:36:0:(genops.c:885:class_export_put()) final put ffff8dab50674800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788843382.300410:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab50674800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788843382.300415:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788843382.300487:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab50677000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788843382.300492:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab5436e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788843382.300602:0:17565:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788843382.300606:0:17565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788843382.300609:0:17565:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 5 00000004:00080000:1.0:1788843382.300614:0:17565:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788843382.300615:0:17565:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788843382.300665:0:17565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843382.300671:0:17565:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788843382.300695:0:17565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843382.300699:0:17565:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788843382.300702:0:17565:0:(genops.c:885:class_export_put()) final put ffff8dab48815000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788843382.300705:0:17565:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab48815000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788843382.300710:0:17565:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788843382.300829:0:17565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915d23 00000020:00000080:1.0:1788843382.300835:0:17565:0:(genops.c:885:class_export_put()) final put ffff8dab71a25000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788843382.300840:0:17565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788843382.300843:0:17565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843382.300847:0:17565:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788843382.300850:0:17565:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8dab60074d28) has no exports 00000020:00000080:1.0:1788843382.300879:0:17565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843382.300884:0:17565:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788843382.300888:0:17565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915d2a 00000020:00000080:1.0:1788843382.300891:0:17565:0:(genops.c:885:class_export_put()) final put ffff8dab71a24000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788843382.300898:0:17565:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dab7c1e8000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788843382.300902:0:17565:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab7c1e8000 3 00000020:01000004:1.0:1788843382.300905:0:17565:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dab7c1e8000 from lustre-MDT0000 00000020:00000080:1.0:1788843382.300922:0:17565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843382.300925:0:17565:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788843382.300928:0:17565:0:(genops.c:885:class_export_put()) final put ffff8dab48812800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788843382.300929:0:17565:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab48812800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788843382.300936:0:17565:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788843382.300961:0:17565:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788843382.300972:0:17565:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788843382.300975:0:17565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788843382.300978:0:17565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843382.300981:0:17565:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788843382.300988:0:17565:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dab43789000 845ba2f4-9198-464f-ba29-11072ff30647 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788843382.300994:0:17565:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8dab7ffdb370) has exports, disconnecting them 00000020:00080000:1.0:1788843382.300998:0:17565:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8dab43789000), last request at 1788843299 00000020:00000080:1.0:1788843382.301013:0:17565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915ccf 00000020:00010000:1.0:1788843382.301017:0:17565:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dab43789000: total 2 00000100:00080000:1.0:1788843382.301021:0:17565:0:(import.c:65:import_set_state_nolock()) ffff8dab4378b800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788843382.301093:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab50397800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788843382.301100:0:36:0:(genops.c:885:class_export_put()) final put ffff8dab50675800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788843382.301103:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab50675800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788843382.301107:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788843382.301168:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab71a25000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788843382.301171:0:36:0:(genops.c:885:class_export_put()) final put ffff8dab48813800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788843382.301174:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab48813800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788843382.301177:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788843382.301263:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab71a24000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:1.0:1788843382.301390:0:17565:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dab43789000): rc 0 00000020:00080000:1.0:1788843382.301395:0:17565:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8dab7ffdb370) has no exports 00000100:00100000:0.0:1788843382.301489:0:14413:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8dab48904600:14413] 0 exiting: rc = 1 00000020:00010000:2.0:1788843382.301907:0:14409:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dab43789000: total 0 00010000:00010000:2.0:1788843382.301941:0:14409:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dab43789000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788843382.301971:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab49375200/0xc6b8ac1b0915df5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0915dee expref: 9 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843382.301992:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab49374600/0xc6b8ac1b0915f61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0915f5a expref: 8 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843382.302003:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab4933a200/0xc6b8ac1b0915e03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0915dfc expref: 7 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843382.302016:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab49374a00/0xc6b8ac1b09160e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b09160e2 expref: 6 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843382.302038:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab49374800/0xc6b8ac1b0915cdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0915cd6 expref: 5 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843382.302048:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7799f600/0xc6b8ac1b09160f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b09160f0 expref: 4 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843382.302059:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7799fa00/0xc6b8ac1b0915e2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0915e26 expref: 3 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843382.302069:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab49374000/0xc6b8ac1b0915f37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0915f30 expref: 2 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843382.302078:0:14409:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dab43789000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788843382.302092:0:14409:0:(genops.c:885:class_export_put()) final put ffff8dab43789000/845ba2f4-9198-464f-ba29-11072ff30647 00010000:00010000:2.0:1788843382.302109:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843382.302111:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843382.302113:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843382.302140:0:14415:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8dab51b0b400:14415] 2 exiting: rc = 0 00000100:00100000:2.0:1788843382.302204:0:14414:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8dab44160800:14414] 1 exiting: rc = 0 00000020:00000080:0.0:1788843382.302278:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab43789000/845ba2f4-9198-464f-ba29-11072ff30647 for MGS 00000020:00000080:0.0:1788843382.302311:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab4378b800 for MGS 00000100:00100000:1.0:1788843382.302535:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302543:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302549:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302554:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302560:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302567:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302573:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302579:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302585:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302591:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302596:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302603:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302608:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302614:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302618:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302624:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302629:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302635:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302641:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302646:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302651:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302668:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302674:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302679:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302685:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302690:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302695:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302701:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302706:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302715:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302721:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302726:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302731:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302736:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302741:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302745:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302751:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302756:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302761:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302766:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302771:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302775:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302780:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302785:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302789:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302794:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302798:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302803:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302809:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302813:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302818:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302823:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302827:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302832:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302837:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302842:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302854:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302869:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302877:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302881:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302886:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302892:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302897:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.302902:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788843382.303457:0:17565:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788843382.303462:0:17565:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788843382.304906:0:17565:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8daa42b2d600 - data ffff8dab5f5cf870/ffff8dab7f6c9800 00000020:01000000:1.0:1788843382.305041:0:17565:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dab58f6fd80 - data ffff8dab5f72ea20/ffff8dab7c05f800 00000020:00000080:1.0:1788843382.305636:0:17565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915cb3 00000020:00000080:1.0:1788843382.305645:0:17565:0:(genops.c:885:class_export_put()) final put ffff8dab43789800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788843382.305660:0:17565:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dab7c1e8000 from MGS, refs=2 00000020:01000004:1.0:1788843382.305664:0:17565:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab7c1e8000 2 00000020:01000004:1.0:1788843382.305667:0:17565:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dab7c1e8000 from MGS 00000020:00000080:1.0:1788843382.305688:0:17565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843382.305694:0:17565:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788843382.305696:0:17565:0:(genops.c:885:class_export_put()) final put ffff8dab43788800/MGS 00000020:00000080:1.0:1788843382.305699:0:17565:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab43788800/MGS for MGS 00000020:01000000:1.0:1788843382.305706:0:17565:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788843382.305762:0:17565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788843382.305766:0:17565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843382.305771:0:17565:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788843382.305778:0:17565:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8dab5157e000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788843382.305783:0:17565:0:(genops.c:1553:class_disconnect_exports()) OBD device 10 (ffff8dab477dcd28) has exports, disconnecting them 00000020:00080000:1.0:1788843382.305788:0:17565:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8dab5157e000), last request at 1788843299 00000020:00000080:1.0:1788843382.305792:0:17565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915da1 00000020:00080000:1.0:1788843382.305801:0:17565:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dab5157e000): rc 0 00000020:00000080:1.0:1788843382.305805:0:17565:0:(genops.c:885:class_export_put()) final put ffff8dab5157e000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788843382.306389:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab43789800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788843382.306398:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab5157e000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788843382.311445:0:17565:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788843382.311455:0:17565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788843382.311459:0:17565:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788843382.311466:0:17565:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788843382.311659:0:17565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843382.311669:0:17565:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788843382.311685:0:17565:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab7c1e8000 1 00000020:00000080:0.0:1788843382.311692:0:17565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915ca5 00000020:00000080:0.0:1788843382.311701:0:17565:0:(genops.c:885:class_export_put()) final put ffff8dab43788000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788843382.311707:0:17565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788843382.311711:0:17565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843382.311716:0:17565:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788843382.311721:0:17565:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8dab477d8000) has no exports 00000020:00000080:2.0:1788843382.311796:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab6e2c6800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788843382.311805:0:38:0:(genops.c:885:class_export_put()) final put ffff8dab6e2c4000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788843382.311808:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab6e2c4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788843382.311820:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788843382.311893:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab43788000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788843382.325555:0:17565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843382.325572:0:17565:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788843382.325591:0:17565:0:(genops.c:885:class_export_put()) final put ffff8dab7c1ef800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788843382.325595:0:17565:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7c1ef800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788843382.325608:0:17565:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788843382.325743:0:17565:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dab7c1eb000 00000020:01000000:2.0:1788843382.325765:0:17565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788843382.325769:0:17565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843382.325773:0:17565:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788843382.325778:0:17565:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8dab60073370) has no exports 00000100:00100000:2.0:1788843382.325852:0:14420:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8dab49332a00:14420] 0 exiting: rc = 1 00000100:00100000:2.0:1788843382.326471:0:14422:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8dab6998a200:14422] 2 exiting: rc = 0 00000100:00100000:3.0:1788843382.326761:0:14421:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8dab77aaba00:14421] 1 exiting: rc = 0 00010000:00010000:0.0:1788843382.340527:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843382.388721:0:15380:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8dab44161c00:15380] 3 exiting: rc = 0 00000100:00100000:2.0:1788843382.395853:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.395874:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.395882:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.395889:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.395896:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.395904:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.395911:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.395918:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.395924:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.395932:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.395943:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.395950:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.395961:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.395970:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.395978:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.395986:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396033:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396042:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396050:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396059:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396069:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396077:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396086:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396096:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396121:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396134:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396139:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396145:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396151:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396160:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396166:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396171:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396179:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396186:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396191:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396197:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396202:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396208:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396214:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396220:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396226:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396231:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396236:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396246:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396252:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396257:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396265:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396280:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396290:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396296:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396301:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396310:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396315:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396320:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396327:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396336:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396361:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396368:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396374:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396391:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396397:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396402:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396408:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.396413:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.405288:0:14423:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8dab60023c00:14423] 0 exiting: rc = 1 00000100:00100000:2.0:1788843382.406253:0:14424:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8dab60022000:14424] 1 exiting: rc = 0 00000100:00100000:0.0:1788843382.409113:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409125:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409135:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409142:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409149:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409157:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409165:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409172:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409183:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409194:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409204:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409209:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409220:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409227:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409232:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409237:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409241:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409247:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409252:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409258:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409265:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409729:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409738:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409743:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409748:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409767:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409774:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409779:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409784:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409789:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409795:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409800:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409806:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409811:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409817:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409822:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409827:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409832:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409837:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409841:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409846:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409850:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409856:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409873:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409879:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409887:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409891:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409896:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409902:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409908:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409913:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409918:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409923:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409929:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409934:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409939:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409944:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409950:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409957:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409963:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409977:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409982:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409987:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.409993:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.412939:0:14426:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8dab60022c00:14426] 1 exiting: rc = 0 00000100:00100000:0.0:1788843382.413070:0:14425:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8dab51b34200:14425] 0 exiting: rc = 1 00000100:00100000:1.0:1788843382.413194:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413210:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413217:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413223:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413229:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413236:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413241:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413247:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413253:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413259:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413265:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413280:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413287:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413308:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413316:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413322:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413328:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413335:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413367:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413375:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413381:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413387:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413393:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413398:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413404:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413426:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413434:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413440:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413446:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413452:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413458:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413463:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413470:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413476:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413482:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413501:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413508:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413529:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413537:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413543:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413549:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413810:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413820:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413825:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413831:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413838:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413843:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413848:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413855:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413888:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413895:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413900:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413906:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413911:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413917:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413923:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413929:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413935:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413941:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413946:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413951:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413969:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413976:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843382.413982:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.446201:0:14427:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8dab43a95400:14427] 0 exiting: rc = 1 00000100:00100000:2.0:1788843382.446295:0:14428:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8dab4529ce00:14428] 1 exiting: rc = 0 00000100:00100000:0.0:1788843382.447081:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447092:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447097:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447103:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447111:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447119:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447126:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447133:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447138:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447142:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447148:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447154:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447160:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447165:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447170:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447176:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447181:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447187:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447192:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447197:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447202:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447206:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447211:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447216:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447220:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447225:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447230:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447235:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447241:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447246:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447281:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447287:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447293:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447298:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447304:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447309:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447315:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447321:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447326:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447331:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447336:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447358:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447365:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447372:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447379:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447386:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447393:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447401:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447407:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447412:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447418:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447423:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447427:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447431:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447436:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447441:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447446:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447451:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447456:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447461:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447466:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447470:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447475:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.447480:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.448015:0:14429:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8dab47377000:14429] 0 exiting: rc = 1 00000100:00100000:2.0:1788843382.448407:0:14430:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8dab47376400:14430] 1 exiting: rc = 0 00000100:00100000:0.0:1788843382.450087:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450096:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450102:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450107:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450114:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450119:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450124:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450129:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450135:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450140:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450145:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450151:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450156:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450161:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450166:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450171:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450177:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450182:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450187:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450192:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450196:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450201:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450205:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450210:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450215:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450220:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450225:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450231:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450236:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450242:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450247:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450252:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450257:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450262:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450268:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450288:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450293:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450298:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450303:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450309:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450314:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450319:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450324:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450329:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450334:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450338:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450360:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450365:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450369:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450375:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450380:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450385:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450390:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450395:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450400:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450406:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450411:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450416:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450421:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450426:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450431:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450436:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450440:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.450446:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843382.450819:0:14432:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8dab69e05600:14432] 1 exiting: rc = 0 00000100:00100000:3.0:1788843382.454602:0:14431:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8dab69e05000:14431] 0 exiting: rc = 1 00000100:00100000:0.0:1788843382.458190:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458200:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458206:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458211:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458216:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458221:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458252:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458258:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458264:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458269:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458274:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458280:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458285:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458291:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458297:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458303:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458309:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458314:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458319:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458325:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458330:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458336:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458354:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458360:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458365:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458370:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458376:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458382:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458386:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458391:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458397:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458403:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458408:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458413:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458419:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458424:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458430:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458435:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458444:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458450:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458456:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458469:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458475:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458481:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458486:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458492:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458497:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458503:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458509:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458515:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458520:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458526:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458531:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458536:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458542:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458548:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.458553:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.460163:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.460173:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.460178:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.460183:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.460189:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.460194:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.460200:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843382.461620:0:14433:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8dab4892ee00:14433] 0 exiting: rc = 1 00000100:00100000:0.0:1788843382.462255:0:14434:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8dab4892e200:14434] 1 exiting: rc = 0 00000100:00100000:0.0:1788843382.462415:0:14435:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8dab7c0b8c00:14435] 2 exiting: rc = 0 00000100:00100000:0.0:1788843382.462474:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462482:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462488:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462497:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462504:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462512:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462519:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462526:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462532:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462539:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462576:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462598:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462604:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462610:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462616:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462621:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462627:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462643:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462649:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462655:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462660:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462666:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462671:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462677:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462684:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462689:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462694:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462700:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462706:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462719:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462725:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462731:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462736:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462742:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462748:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462768:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.462775:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.463603:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.463612:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.463618:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.464622:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.464866:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.464876:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.464883:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.464888:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.464913:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.464919:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.464924:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.464931:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.464937:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.464944:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.464951:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.464957:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.464963:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.464969:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.464975:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.464981:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.464986:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.464991:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.465018:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.465025:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.465031:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.465037:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843382.465044:0:17565:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788843382.477481:0:17565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843382.477495:0:17565:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788843382.477501:0:17565:0:(genops.c:885:class_export_put()) final put ffff8dab7fd0f000/MDS_uuid 00000020:00000080:1.0:1788843382.477505:0:17565:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7fd0f000/MDS_uuid for MDS 00000020:01000000:1.0:1788843382.477515:0:17565:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788843382.477669:0:17565:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788843383.366732:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843384.389075:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788843385.390739:0:17718:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00010000:00010000:2.0:1788843385.413888:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788843385.415091:0:17718:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788843385.415141:0:17718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7799ec00/0xc6b8ac1b0915e26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915e2d expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843385.415157:0:17718:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7799ec00/0xc6b8ac1b0915e26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915e2d expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843385.415165:0:17718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7799ec00/0xc6b8ac1b0915e26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0915e2d expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843385.415173:0:17718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab7799ec00/0xc6b8ac1b0915e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0915e2d expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843385.415193:0:17718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788843385.415212:0:17718:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788843385.415236:0:17718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788843385.415240:0:17718:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788843385.415246:0:17718:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788843385.415252:0:17718:0:(import.c:65:import_set_state_nolock()) ffff8dab48b91800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788843385.415257:0:17718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788843385.415259:0:17718:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788843385.415262:0:17718:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788843385.417054:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843385.417067:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab7799ec00/0xc6b8ac1b0915e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0915e2d expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843385.417089:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799ec00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843385.417093:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab7799ec00/0xc6b8ac1b0915e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0915e2d expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843385.417103:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab7799ec00/0xc6b8ac1b0915e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0915e2d expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843385.417110:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab7799ec00/0xc6b8ac1b0915e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0915e2d expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843385.417115:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788843385.417118:0:14408:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788843385.417136:0:14408:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788843385.417175:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab7799ec00/0xc6b8ac1b0915e26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0915e2d expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843385.417181:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843385.417209:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab7799ec00/0xc6b8ac1b0915e26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0915e2d expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843385.417216:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab7799ec00/0xc6b8ac1b0915e26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0915e2d expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843385.417229:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843385.417231:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843385.417232:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843385.417305:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843385.417323:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:845ba2f4-9198-464f-ba29-11072ff30647:3304:1875737795739904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843385.417406:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843385.417816:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795739904 00000100:00100000:1.0:1788843385.417825:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795739904 00000100:00100000:1.0:1788843385.417884:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788843385.417891:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3304:x1875737795739904:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788843385.417898:0:14405:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788843385 with bad export cookie 894961515458813135 00010000:00010000:0.0:1788843385.419368:0:17718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b0915dfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915e03 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843385.419383:0:17718:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b0915dfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915e03 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843385.419390:0:17718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b0915dfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0915e03 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843385.419398:0:17718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b0915dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0915e03 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843385.419411:0:17718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843385.419416:0:17718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7799e200/0xc6b8ac1b09160f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09160f7 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843385.420270:0:17718:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7799e200/0xc6b8ac1b09160f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b09160f7 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843385.420280:0:17718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7799e200/0xc6b8ac1b09160f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b09160f7 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843385.420306:0:17718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab7799e200/0xc6b8ac1b09160f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b09160f7 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843385.420458:0:17718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788843385.420464:0:17718:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788843385.420494:0:17718:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788843385.420498:0:17718:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788843385.420504:0:17718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843385.420509:0:17718:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788843385.420513:0:17718:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dab7ffdcd28) has no exports 00000020:00080000:0.0:1788843385.420549:0:17718:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dab7ffdcd28) has no exports 00010000:00010000:3.0:1788843385.425409:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788843385.425424:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b0915dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0915e03 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843385.425437:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5800 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843385.425441:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b0915dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0915e03 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843385.425452:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b0915dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0915e03 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843385.425460:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b0915dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0915e03 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843385.425486:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788843385.425489:0:14408:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788843385.425492:0:14408:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788843385.425552:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b0915dfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0915e03 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843385.425559:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843385.425590:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b0915dfc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0915e03 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843385.425598:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b0915dfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0915e03 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843385.425614:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843385.425618:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab7799e200/0xc6b8ac1b09160f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b09160f7 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843385.425623:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799e200 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843385.426710:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab7799e200/0xc6b8ac1b09160f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b09160f7 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843385.426724:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab7799e200/0xc6b8ac1b09160f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b09160f7 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843385.426731:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab7799e200/0xc6b8ac1b09160f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b09160f7 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843385.426737:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788843385.426739:0:14408:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788843385.426742:0:14408:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788843385.426777:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab7799e200/0xc6b8ac1b09160f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b09160f7 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843385.426784:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843385.426795:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab7799e200/0xc6b8ac1b09160f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b09160f7 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843385.426801:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab7799e200/0xc6b8ac1b09160f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b09160f7 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843385.426814:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843385.426816:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843385.426818:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843385.426854:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795740032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843385.426920:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843385.426986:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843385.426992:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795740160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843385.427016:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843385.427050:0:14406:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788843385.427059:0:14406:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788843385.427075:0:14407:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788843385.427082:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795740032 00000100:00100000:3.0:1788843385.427089:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795740032 00000100:00100000:3.0:1788843385.427117:0:14407:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788843385.427123:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795740160 00000100:00100000:3.0:1788843385.427126:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795740160 00000020:01000000:0.0:1788843385.427698:0:17718:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dab7776b180 - data ffff8dab77edce58/ffff8daa4125b800 00000020:01000000:0.0:1788843385.427851:0:17718:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dab43332840 - data ffff8dab77cec0d8/ffff8dab74600000 00010000:00010000:2.0:1788843385.428321:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843385.428522:0:17719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788843385.428531:0:17719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43782d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3306:x1875737795740032:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788843385.428538:0:17719:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788843385 with bad export cookie 894961515458813135 00000100:00100000:3.0:1788843385.428605:0:17719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43782d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3306:x1875737795740032:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (1684us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788843385.429039:0:17719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788843385.429086:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788843385.429090:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8dab7c1e8800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788843385.429094:0:3306:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.129@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:2.0:1788843385.429465:0:17719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843385.429472:0:17719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3306:x1875737795740160:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788843385.429478:0:17719:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788843385 with bad export cookie 894961515458813135 00000100:00100000:2.0:1788843385.429525:0:17719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3306:x1875737795740160:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (2508us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788843385.429531:0:17719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788843385.443487:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3304:x1875737795739904:12345-0@lo:103:ldlm_bl.0 Request processed in 25590us (26077us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788843385.443502:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788843385.443889:0:3304:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788843385.479652:0:3306:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.129@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788843385.479659:0:3306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788843385.479669:0:3306:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dab43782300 x1875737795739904/t0(0) o103->MGC192.168.203.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788843401 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843385.479685:0:3306:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dab43780e00 x1875737795740032/t0(0) o103->MGC192.168.203.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788843401 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843385.479693:0:3306:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dab43783800 x1875737795740160/t0(0) o103->MGC192.168.203.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788843401 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788843385.479830:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788843385.479833:0:3306:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788843385.479835:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788843385.479848:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8dab7c1e8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843385.479853:0:3306:0:(import.c:510:import_select_connection()) MGC192.168.203.129@tcp: connect to NID 0@lo last attempt 423 00000100:00080000:3.0:1788843385.479862:0:3306:0:(import.c:624:import_select_connection()) MGC192.168.203.129@tcp: import ffff8dab7c1e8800 using connection 192.168.203.129@tcp/0@lo 00000100:00080000:2.0:1788843385.479915:0:3304:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8dab7c1e8800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:2.0:1788843385.480125:0:3306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab73a79180 x1875737795740288/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843385.480148:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:845ba2f4-9198-464f-ba29-11072ff30647:3304:1875737795739904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843385.480172:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795740160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843385.480177:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795740032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843385.481521:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:845ba2f4-9198-464f-ba29-11072ff30647:3303:1875737795740288:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788843385.481578:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875737795740288 offset 0 length 520: 4 00100000:10000000:2.0:1788843385.482713:0:17718:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788843385.525785:0:17718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915e11 00000020:00000080:3.0:1788843385.525794:0:17718:0:(genops.c:885:class_export_put()) final put ffff8dab441f9000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788843385.525809:0:17718:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dab50469800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788843385.525813:0:17718:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab50469800 2 00000020:01000004:3.0:1788843385.525816:0:17718:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dab50469800 from lustre-OST0000 00000020:00000080:3.0:1788843385.525848:0:17718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788843385.525859:0:17718:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788843385.525861:0:17718:0:(genops.c:885:class_export_put()) final put ffff8dab441f8800/lustre-OST0000_UUID 00000020:00000080:3.0:1788843385.525864:0:17718:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab441f8800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788843385.525871:0:17718:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788843385.525946:0:17718:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788843385.525950:0:17718:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788843385.525954:0:17718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788843385.525959:0:17718:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788843385.525965:0:17718:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8dab7fcb2800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788843385.525970:0:17718:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8dab7f7119b8) has exports, disconnecting them 00000020:00080000:3.0:1788843385.525975:0:17718:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8dab7fcb2800), last request at 1788843316 00000020:00000080:3.0:1788843385.525979:0:17718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915e3b 00000020:00080000:3.0:1788843385.525989:0:17718:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dab7fcb2800): rc 0 00000020:00000080:3.0:1788843385.525994:0:17718:0:(genops.c:885:class_export_put()) final put ffff8dab7fcb2800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788843385.526485:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab441f9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788843385.526499:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7fcb2800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788843385.527485:0:17718:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788843385.527493:0:17718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788843385.527498:0:17718:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788843385.527505:0:17718:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788843385.527681:0:17718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843385.527689:0:17718:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788843385.527696:0:17718:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab50469800 1 00000020:00000080:1.0:1788843385.527701:0:17718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915de0 00000020:00000080:1.0:1788843385.527707:0:17718:0:(genops.c:885:class_export_put()) final put ffff8dab48810800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788843385.527712:0:17718:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788843385.527717:0:17718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843385.527721:0:17718:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788843385.527724:0:17718:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8dab7ffd99b8) has no exports 00000020:00000080:3.0:1788843385.528260:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab48b91800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788843385.528269:0:38:0:(genops.c:885:class_export_put()) final put ffff8dab51a7f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788843385.528272:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab51a7f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788843385.528278:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788843385.528332:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab48810800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788843385.559085:0:17718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843385.559103:0:17718:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788843385.559110:0:17718:0:(genops.c:885:class_export_put()) final put ffff8dab5046b000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788843385.559240:0:17718:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab5046b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788843385.559318:0:17718:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788843385.559481:0:17718:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dab50468800 00000020:02000400:1.0:1788843385.559529:0:17718:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788843386.438773:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788843386.697590:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 845ba2f4-9198-464f-ba29-11072ff30647->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788843386.697600:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 845ba2f4-9198-464f-ba29-11072ff30647->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788843386.697603:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788843386.697607:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788843386.697611:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dab7f6e3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843386.697620:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 505 00000100:00080000:3.0:1788843386.697626:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788843386.697633:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dab7f6e3000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1788843386.697673:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab43780a80 x1875737795740416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788843386.698915:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875737795740416:0@lo:38:kworker.0 00000400:00000100:1.0:1788843386.698969:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875737795740416 offset 0 length 520: 4 00010000:00010000:2.0:1788843387.462962:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843388.484685:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788843388.539653:0:17869:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788843388.555530:0:17869:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788843388.555611:0:17869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab49374400/0xc6b8ac1b0915f5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915f61 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843388.555627:0:17869:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab49374400/0xc6b8ac1b0915f5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915f61 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843388.555635:0:17869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab49374400/0xc6b8ac1b0915f5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0915f61 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843388.555642:0:17869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab49374400/0xc6b8ac1b0915f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0915f61 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843388.555663:0:17869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788843388.555669:0:17869:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788843388.555689:0:17869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788843388.555700:0:17869:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dab43780a80 x1875737795740416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788843401 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843388.555717:0:17869:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788843388.555723:0:17869:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788843388.555729:0:17869:0:(import.c:65:import_set_state_nolock()) ffff8dab7f6e3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788843388.555733:0:17869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788843388.555737:0:17869:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dab43780a80 x1875737795740416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788843401 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843388.555744:0:17869:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788843388.555747:0:17869:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:2.0:1788843388.555874:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843388.555883:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab49374400/0xc6b8ac1b0915f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0915f61 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843388.555891:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374400 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:2.0:1788843388.555895:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab49374400/0xc6b8ac1b0915f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0915f61 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843388.555903:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab49374400/0xc6b8ac1b0915f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0915f61 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843388.555911:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab49374400/0xc6b8ac1b0915f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0915f61 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843388.555916:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788843388.555919:0:14409:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788843388.555921:0:14409:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788843388.555935:0:14409:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dab7c1e8800 00010000:00010000:2.0:1788843388.555939:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab49374400/0xc6b8ac1b0915f5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b8ac1b0915f61 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843388.555946:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab49374400/0xc6b8ac1b0915f5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b8ac1b0915f61 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843388.555959:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843388.555961:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843388.555962:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843388.557382:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875737795740416:0@lo:38:kworker.0 00010000:00010000:3.0:1788843388.558677:0:17869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7799ee00/0xc6b8ac1b0915f30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915f37 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843388.558692:0:17869:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7799ee00/0xc6b8ac1b0915f30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915f37 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843388.558713:0:17869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7799ee00/0xc6b8ac1b0915f30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0915f37 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843388.558720:0:17869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab7799ee00/0xc6b8ac1b0915f30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0915f37 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843388.558740:0:17869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788843388.558748:0:17869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b09160e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09160e9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843388.558754:0:17869:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b09160e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b09160e9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843388.558760:0:17869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b09160e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b09160e9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843388.558766:0:17869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b09160e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b09160e9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843388.558779:0:17869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788843388.558783:0:17869:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788843388.558802:0:17869:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788843388.558807:0:17869:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788843388.558811:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788843388.558826:0:17869:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788843388.558830:0:17869:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8dab7f713370) has no exports 00000020:00080000:3.0:1788843388.558855:0:17869:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8dab7f713370) has no exports 00010000:00010000:2.0:1788843388.559656:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843388.559667:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab7799ee00/0xc6b8ac1b0915f30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0915f37 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843388.559689:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799ee00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:2.0:1788843388.559693:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab7799ee00/0xc6b8ac1b0915f30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0915f37 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843388.559702:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab7799ee00/0xc6b8ac1b0915f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0915f37 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843388.559709:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab7799ee00/0xc6b8ac1b0915f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0915f37 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843388.559714:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788843388.559717:0:14409:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788843388.559719:0:14409:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788843388.559735:0:14409:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dab7c1e8800 00010000:00010000:2.0:1788843388.559738:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab7799ee00/0xc6b8ac1b0915f30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b8ac1b0915f37 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843388.559744:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab7799ee00/0xc6b8ac1b0915f30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b8ac1b0915f37 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843388.559757:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843388.559761:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b09160e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b09160e9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843388.559765:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933a600 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:2.0:1788843388.559768:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b09160e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b09160e9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843388.559774:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b09160e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b09160e9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843388.559787:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b09160e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b09160e9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843388.559793:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788843388.559795:0:14409:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788843388.559797:0:14409:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788843388.559803:0:14409:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dab7c1e8800 00010000:00010000:2.0:1788843388.559806:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b09160e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b8ac1b09160e9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843388.559812:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b09160e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b8ac1b09160e9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843388.559834:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843388.559835:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843388.559837:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843388.560305:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788843388.563798:0:17869:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dab7fc0e4e0 - data ffff8dab4a77ee58/ffff8dab73d92c00 00000020:01000000:3.0:1788843388.564896:0:17869:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8daa420cdc00 - data ffff8dab5f7071b0/ffff8dab7c00c800 00100000:10000000:2.0:1788843388.579556:0:17869:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788843388.623096:0:17869:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915f45 00000020:00000080:0.0:1788843388.623105:0:17869:0:(genops.c:885:class_export_put()) final put ffff8dab7fc85800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788843388.623166:0:17869:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dab441fb000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788843388.623171:0:17869:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab441fb000 2 00000020:01000004:0.0:1788843388.623174:0:17869:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dab441fb000 from lustre-OST0001 00000020:00000080:0.0:1788843388.623197:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843388.623207:0:17869:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788843388.623211:0:17869:0:(genops.c:885:class_export_put()) final put ffff8dab7c18b000/lustre-OST0001_UUID 00000020:00000080:0.0:1788843388.623214:0:17869:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7c18b000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788843388.623220:0:17869:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788843388.623379:0:17869:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 845ba2f4-9198-464f-ba29-11072ff30647->MGS 00010000:00010000:0.0:1788843388.623393:0:17869:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0915dee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0915df5 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843388.623404:0:17869:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0915dee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0915df5 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843388.623420:0:17869:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788843388.623423:0:17869:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788843388.623426:0:17869:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788843388.623452:0:17869:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dab7c1e8800 00010000:00010000:0.0:1788843388.623455:0:17869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0915dee lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b8ac1b0915df5 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843388.623469:0:17869:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0915cd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0915cdd expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843388.623476:0:17869:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0915cd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0915cdd expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843388.623480:0:17869:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788843388.623483:0:17869:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788843388.623484:0:17869:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788843388.623492:0:17869:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dab7c1e8800 00010000:00010000:0.0:1788843388.623495:0:17869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0915cd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b8ac1b0915cdd expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788843388.623512:0:17869:0:(import.c:65:import_set_state_nolock()) ffff8dab7c1e8800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788843388.623516:0:17869:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788843388.623518:0:17869:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788843388.623519:0:17869:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788843388.623524:0:17869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788843388.623534:0:17869:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dab73a79180 x1875737795740288/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788843395 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788843388.623558:0:17869:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788843388.623561:0:17869:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1788843388.623826:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:845ba2f4-9198-464f-ba29-11072ff30647:3303:1875737795740288:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:0.0:1788843388.624868:0:17869:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788843388.624889:0:17869:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915cc1 00000020:00000080:0.0:1788843388.624896:0:17869:0:(genops.c:885:class_export_put()) final put ffff8dab7fd0a800/845ba2f4-9198-464f-ba29-11072ff30647 00000020:00000080:1.0:1788843388.626982:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7fc85800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788843388.629448:0:17869:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.129@tcp (flags='') 00000020:00000080:0.0:1788843388.629461:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843388.629470:0:17869:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.129@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788843388.629475:0:17869:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8dab477db370) has no exports 00000020:00000080:1.0:1788843388.629540:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7fd0a800/845ba2f4-9198-464f-ba29-11072ff30647 for MGC192.168.203.129@tcp 10000000:01000000:3.0:1788843388.629749:0:14417:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788843388.629772:0:17869:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.129@tcp: client import never connected 00000100:00080000:0.0:1788843388.629776:0:17869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788843388.629780:0:17869:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788843388.629783:0:17869:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788843388.629785:0:17869:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788843388.629870:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843388.629877:0:17869:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.129@tcp (uuid 845ba2f4-9198-464f-ba29-11072ff30647) 00000020:01000000:0.0:1788843388.629883:0:17869:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788843388.629886:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843388.629890:0:17869:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788843388.629896:0:17869:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8daa42669000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788843388.629901:0:17869:0:(genops.c:1553:class_disconnect_exports()) OBD device 17 (ffff8dab440eb370) has exports, disconnecting them 00000020:00080000:0.0:1788843388.629906:0:17869:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8daa42669000), last request at 1788843330 00000020:00000080:0.0:1788843388.629910:0:17869:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915f6f 00000020:00080000:0.0:1788843388.629923:0:17869:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8daa42669000): rc 0 00000020:00000080:0.0:1788843388.629927:0:17869:0:(genops.c:885:class_export_put()) final put ffff8daa42669000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788843388.629951:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab7c1e8800 for MGC192.168.203.129@tcp 00000020:00000080:1.0:1788843388.629958:0:38:0:(genops.c:885:class_export_put()) final put ffff8dab7c1ee000/845ba2f4-9198-464f-ba29-11072ff30647 00000020:00000080:1.0:1788843388.629960:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7c1ee000/845ba2f4-9198-464f-ba29-11072ff30647 for MGC192.168.203.129@tcp 00000020:01000000:1.0:1788843388.629967:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.129@tcp (845ba2f4-9198-464f-ba29-11072ff30647) 00000020:00000080:1.0:1788843388.638296:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8daa42669000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788843388.639394:0:17869:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788843388.639402:0:17869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788843388.639406:0:17869:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788843388.639412:0:17869:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788843388.639587:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab7f6e3000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1788843388.642410:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788843388.642504:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1788843388.642636:0:14404:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8dab69c34c00:14404] 1 exiting: rc = 0 00000100:00100000:3.0:1788843388.642699:0:14403:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8dab69c34600:14403] 0 exiting: rc = 1 00000100:00100000:1.0:1788843388.642865:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.643142:0:14405:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8dab441aee00:14405] 0 exiting: rc = 1 00000100:00100000:3.0:1788843388.643400:0:14407:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8dab69c34a00:14407] 2 exiting: rc = 0 00000100:00100000:3.0:1788843388.643450:0:14406:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8dab69c35a00:14406] 1 exiting: rc = 0 00000100:00100000:2.0:1788843388.643962:0:17719:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8dab5db98e00:17719] 3 exiting: rc = 0 00000100:00100000:1.0:1788843388.644079:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644093:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644100:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644106:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644112:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644129:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644134:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644139:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644143:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644148:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644153:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644158:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644162:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644167:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644172:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644178:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644183:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644188:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644193:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644199:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644204:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644210:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644215:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644220:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644239:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644246:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644252:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644268:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644273:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644279:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644284:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644289:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644294:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644298:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644303:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644308:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644314:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644319:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644324:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644329:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644359:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644367:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644374:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644380:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644385:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644389:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644394:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644400:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644405:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644410:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644415:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644421:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644426:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644545:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644551:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644556:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644561:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644566:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644570:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644575:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644580:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644585:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644589:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.644595:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788843388.645639:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843388.645651:0:17869:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788843388.645656:0:17869:0:(genops.c:885:class_export_put()) final put ffff8daa4266e800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788843388.645661:0:17869:0:(genops.c:844:class_export_destroy()) destroying export ffff8daa4266e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788843388.645666:0:17869:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788843388.645711:0:17869:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab441fb000 1 00000020:00000080:1.0:1788843388.645718:0:17869:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0915f29 00000020:00000080:1.0:1788843388.645724:0:17869:0:(genops.c:885:class_export_put()) final put ffff8dab7c188800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788843388.645747:0:17869:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788843388.645751:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843388.645763:0:17869:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00000080:3.0:1788843388.645768:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7c188800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00080000:1.0:1788843388.645769:0:17869:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8dab7ffd8000) has no exports 00000020:00000080:3.0:1788843388.685800:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788843388.685823:0:17869:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788843388.685829:0:17869:0:(genops.c:885:class_export_put()) final put ffff8dab7f6e0800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788843388.685833:0:17869:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7f6e0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788843388.685843:0:17869:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788843388.686035:0:17869:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dab7f6e2800 00000020:01000000:3.0:1788843388.686055:0:17869:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788843388.686058:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788843388.686063:0:17869:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788843388.686066:0:17869:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8dab477d99b8) has no exports 00000020:00000080:3.0:1788843388.686107:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788843388.686114:0:17869:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788843388.686117:0:17869:0:(genops.c:885:class_export_put()) final put ffff8dab48811800/OSS_uuid 00000020:00000080:3.0:1788843388.686120:0:17869:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab48811800/OSS_uuid for OSS 00000020:01000000:3.0:1788843388.686133:0:17869:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788843388.686210:0:15108:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8dab462e1200:15108] 2 exiting: rc = 0 00000100:00080000:2.0:1788843388.686292:0:14416:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788843388.686296:0:15105:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8dab77b39400:15105] 0 exiting: rc = 1 00000100:00100000:3.0:1788843388.686402:0:15107:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8dab7c1b0000:15107] 1 exiting: rc = 0 00000100:00100000:1.0:1788843388.728657:0:16114:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8dab776c8800:16114] 3 exiting: rc = 0 00000100:00100000:3.0:1788843388.728827:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728838:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728844:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728863:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728868:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728875:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728880:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728885:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728890:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728896:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728900:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728905:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728910:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728915:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728921:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728927:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728934:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728938:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728944:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728949:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728954:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728960:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728965:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728970:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728975:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728980:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728985:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728990:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.728996:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729001:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729006:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729012:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729016:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729021:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729026:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729031:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729036:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729044:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729058:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729064:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729068:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729074:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729078:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729083:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729088:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729103:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729110:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729116:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729121:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729134:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729139:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729144:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729149:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729155:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729162:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729167:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729172:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729177:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729181:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729186:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729190:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729195:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729199:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.729204:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.733995:0:15109:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8dab7bc49600:15109] 0 exiting: rc = 1 00000100:00100000:3.0:1788843388.735713:0:15110:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8dab7bc48a00:15110] 1 exiting: rc = 0 00000100:00100000:3.0:1788843388.735806:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735812:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735827:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735832:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735837:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735842:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735847:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735852:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735875:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735881:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735889:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735894:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735899:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735904:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735910:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735915:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735920:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735926:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735931:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735936:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735941:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735946:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735951:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735957:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735962:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735968:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735973:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735978:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735983:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735987:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735992:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.735997:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736001:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736006:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736012:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736020:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736024:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736029:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736034:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736039:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736044:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736049:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736054:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736065:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736070:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736076:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736081:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736086:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736090:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736095:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736100:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736105:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736109:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736114:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736119:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736134:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736144:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736150:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736155:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736164:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736171:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736176:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736181:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.736187:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.738459:0:15112:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8dab69937600:15112] 1 exiting: rc = 0 00000100:00100000:2.0:1788843388.739338:0:16657:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_004: service thread [ffff8dab746de200:16657] 4 exiting: rc = 0 00000100:00100000:3.0:1788843388.739511:0:16656:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff8dab600f2000:16656] 3 exiting: rc = 0 00000100:00100000:1.0:1788843388.739750:0:15111:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8dab69c08200:15111] 0 exiting: rc = 1 00000100:00100000:3.0:1788843388.739899:0:16658:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_005: service thread [ffff8daa42777400:16658] 5 exiting: rc = 0 00000100:00100000:0.0:1788843388.742334:0:15113:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8dab69936a00:15113] 2 exiting: rc = 0 00000100:00100000:3.0:1788843388.747915:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.747925:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.747931:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.747936:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.747942:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.747948:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.747952:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.747958:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.747963:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.747970:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.747976:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.747982:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.748332:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749596:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749610:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749616:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749622:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749628:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749633:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749639:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749645:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749663:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749670:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749677:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749712:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749720:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749725:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749735:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749741:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749747:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749752:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749757:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749764:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749769:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749774:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749780:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749786:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749791:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749797:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749802:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749808:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749823:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749830:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749835:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749844:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749850:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749856:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.749875:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.750105:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.750112:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.750118:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.750123:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.750128:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.750132:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.750137:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.750142:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.750147:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.750152:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.750164:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.750169:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.750175:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.750180:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.750185:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.750200:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843388.762191:0:15114:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8dab54062400:15114] 0 exiting: rc = 1 00000100:00100000:0.0:1788843388.762789:0:15115:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8dab50707000:15115] 1 exiting: rc = 0 00000100:00100000:3.0:1788843388.762862:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762870:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762875:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762882:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762887:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762892:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762897:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762902:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762907:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762912:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762917:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762923:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762927:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762933:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762938:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762944:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762949:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762954:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762973:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762979:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762984:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762989:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762994:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.762999:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763004:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763009:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763015:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763021:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763030:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763036:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763043:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763051:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763056:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763061:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763068:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763073:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763077:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763082:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763087:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763091:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763096:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763100:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763106:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763111:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763116:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763122:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763127:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763133:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763139:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763144:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763150:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763159:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763164:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763174:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763178:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763183:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763187:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763192:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763196:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763201:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763206:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763212:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763222:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843388.763229:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843388.764874:0:15116:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8dab51663200:15116] 0 exiting: rc = 1 00000100:00100000:1.0:1788843388.765179:0:15117:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8dab51662000:15117] 1 exiting: rc = 0 00000100:00100000:0.0:1788843388.765450:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765458:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765465:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765493:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765501:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765507:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765512:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765528:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765535:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765541:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765546:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765552:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765558:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765565:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765570:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765595:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765602:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765608:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765617:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765639:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765647:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765828:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765837:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765846:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765852:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765858:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765863:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765883:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765889:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765895:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765900:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765905:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765910:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765916:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765921:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765928:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765933:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765941:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765947:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765972:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765979:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.765985:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766002:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766008:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766014:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766021:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766027:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766033:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766039:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766044:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766050:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766070:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766076:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766081:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766085:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766089:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766093:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766096:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766100:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766104:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766108:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766112:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766116:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843388.766126:0:17869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788843388.773573:0:17869:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788843405.387917:0:18486:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788843413.626276:0:18947:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788843413.626280:0:18947:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788843413.626418:0:18947:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dab7c18f800 00000020:01000004:1.0:1788843413.626435:0:18947:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788843413.626443:0:18947:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788843413.626458:0:18947:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8dab6f8719b8) 00000020:00000080:1.0:1788843413.626472:0:18947:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788843413.643613:0:18947:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788843413.645386:0:18947:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:0.0:1788843413.645736:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 339: rc = 0 00100000:10000000:0.0:1788843413.645836:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 339: rc = 0 00100000:10000000:0.0:1788843413.646018:0:18947:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788843413.646085:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 339: rc = 0 00100000:10000000:0.0:1788843413.646183:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 339: rc = 0 00100000:10000000:0.0:1788843413.646281:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 339: rc = 0 00100000:10000000:0.0:1788843413.646482:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 339: rc = 0 00100000:10000000:0.0:1788843413.646742:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 341: rc = 0 00100000:10000000:0.0:1788843413.647736:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 640: rc = 0 00100000:10000000:0.0:1788843413.647841:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 640: rc = 0 00100000:10000000:0.0:1788843413.648332:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 645: rc = 0 00100000:10000000:0.0:1788843413.648604:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 645: rc = 0 00100000:10000000:0.0:1788843413.648874:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 645: rc = 0 00100000:10000000:0.0:1788843413.649107:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 645: rc = 0 00100000:10000000:0.0:1788843413.649365:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 645: rc = 0 00100000:10000000:0.0:1788843413.649614:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 645: rc = 0 00100000:10000000:0.0:1788843413.649869:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 645: rc = 0 00100000:10000000:0.0:1788843413.650118:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 645: rc = 0 00100000:10000000:0.0:1788843413.650461:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 645: rc = 0 00100000:10000000:0.0:1788843413.650723:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 645: rc = 0 00100000:10000000:0.0:1788843413.650998:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 645: rc = 0 00100000:10000000:0.0:1788843413.651239:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 645: rc = 0 00100000:10000000:0.0:1788843413.651688:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 359: rc = 0 00100000:10000000:0.0:1788843413.651959:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 359: rc = 0 00100000:10000000:0.0:1788843413.652214:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 359: rc = 0 00100000:10000000:0.0:1788843413.652487:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 359: rc = 0 00100000:10000000:0.0:1788843413.652739:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 359: rc = 0 00100000:10000000:0.0:1788843413.653008:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 359: rc = 0 00100000:10000000:0.0:1788843413.653261:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 359: rc = 0 00100000:10000000:0.0:1788843413.653526:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 359: rc = 0 00100000:10000000:0.0:1788843413.653802:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 359: rc = 0 00100000:10000000:0.0:1788843413.654059:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 359: rc = 0 00100000:10000000:0.0:1788843413.654304:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 359: rc = 0 00100000:10000000:0.0:1788843413.654665:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 359: rc = 0 00100000:10000000:0.0:1788843413.654914:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 359: rc = 0 00100000:10000000:0.0:1788843413.655164:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 359: rc = 0 00100000:10000000:0.0:1788843413.655430:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 359: rc = 0 00100000:10000000:0.0:1788843413.655684:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 359: rc = 0 00100000:10000000:0.0:1788843413.655934:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 359: rc = 0 00100000:10000000:0.0:1788843413.656403:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 359: rc = 0 00100000:10000000:0.0:1788843413.656663:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 359: rc = 0 00100000:10000000:0.0:1788843413.656902:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 359: rc = 0 00100000:10000000:0.0:1788843413.657145:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 359: rc = 0 00100000:10000000:0.0:1788843413.657429:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 359: rc = 0 00100000:10000000:0.0:1788843413.657686:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 359: rc = 0 00100000:10000000:0.0:1788843413.657920:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 359: rc = 0 00100000:10000000:0.0:1788843413.658151:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 359: rc = 0 00100000:10000000:2.0:1788843413.658639:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 359: rc = 0 00100000:10000000:2.0:1788843413.658909:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 359: rc = 0 00100000:10000000:2.0:1788843413.659158:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 359: rc = 0 00100000:10000000:2.0:1788843413.659437:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 359: rc = 0 00100000:10000000:2.0:1788843413.659697:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 359: rc = 0 00100000:10000000:2.0:1788843413.659922:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 359: rc = 0 00100000:10000000:2.0:1788843413.660154:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 359: rc = 0 00100000:10000000:2.0:1788843413.660542:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 524: rc = 0 00100000:10000000:2.0:1788843413.661043:0:18947:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788843413.661208:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 348: rc = 0 00100000:10000000:2.0:1788843413.661464:0:18947:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788843413.661539:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 348: rc = 0 00100000:10000000:2.0:1788843413.661734:0:18947:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788843413.661802:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 348: rc = 0 00100000:10000000:2.0:1788843413.662152:0:18947:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788843413.662220:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:2.0:1788843413.662504:0:18947:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788843413.662577:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:2.0:1788843413.662775:0:18947:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788843413.662844:0:18947:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00000020:00000080:2.0:1788843413.663092:0:18947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788843413.663100:0:18947:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788843413.663110:0:18947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b091639e 00000020:01000004:2.0:1788843413.663117:0:18947:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788843413.663122:0:18947:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788843413.663126:0:18947:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dab7c18f800 from MGS 00000020:01000004:2.0:1788843413.663130:0:18947:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788843413.663139:0:18947:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8dab440ecd28) 00000020:00000080:2.0:1788843413.663147:0:18947:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788843413.663198:0:18947:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dab7c18f800 from MGS, refs=2 00080000:01000000:2.0:1788843413.663203:0:18947:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788843413.663207:0:18947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b09163ac 00000100:00100000:2.0:1788843413.663299:0:18947:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788843413.663492:0:18947:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788843413.663497:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788843413.664034:0:18947:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788843413.664042:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788843413.664852:0:18947:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843413.665043:0:18947:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788843413.665056:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788843413.665658:0:18947:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788843413.665665:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788843413.665960:0:18947:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788843413.665967:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788843413.666713:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843413.666717:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843413.666719:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843413.666971:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843413.666974:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843413.666976:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843413.667514:0:18947:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788843413.672491:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788843413.676109:0:18947:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788843413.676128:0:18947:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788843413.676131:0:18947:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788843413.677628:0:18956:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788843413.677773:0:18947:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788843413.677869:0:18947:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788843413.680757:0:18947:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788843413.681190:0:18947:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788843413.681420:0:18947:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788843413.681427:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788843413.684663:0:18947:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788843413.684680:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788843413.686657:0:18947:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788843413.686667:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788843413.687407:0:18947:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788843413.687427:0:18947:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.129@tcp' 00000020:01000004:1.0:1788843413.687429:0:18947:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788843413.687459:0:18947:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.129@tcp (typ=mgc) 00000020:00000080:1.0:1788843413.687473:0:18947:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.129@tcp (ffff8dab6f873370) 00000020:00000080:1.0:1788843413.687490:0:18947:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788843413.687563:0:18947:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dab7c18e000@MGC192.168.203.129@tcp: add connection 192.168.203.129@tcp at head 00010000:00010000:1.0:1788843413.687719:0:18947:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.129@tcp-0 is initialized 00000040:01000000:1.0:1788843413.687735:0:18947:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788843413.688146:0:18962:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788843413.689425:0:18947:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.129@tcp (uuid 345dfd18-3e4c-44c0-bf46-62bd805326d9) 00000020:00000080:2.0:1788843413.689448:0:18947:0:(genops.c:1385:class_connect()) connect: client 345dfd18-3e4c-44c0-bf46-62bd805326d9, cookie 0xc6b8ac1b09163ba 00000100:00080000:2.0:1788843413.689460:0:18947:0:(import.c:510:import_select_connection()) MGC192.168.203.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788843413.689465:0:18947:0:(import.c:624:import_select_connection()) MGC192.168.203.129@tcp: import ffff8dab7c18e000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1788843413.689495:0:18947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab73a79f80 x1875737795740544/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843413.689522:0:18947:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 345dfd18-3e4c-44c0-bf46-62bd805326d9->MGS 00000020:01000004:2.0:1788843413.689546:0:18947:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788843413.689551:0:18947:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788843413.689563:0:18947:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8dab440e8000) 00000020:00000080:2.0:1788843413.689574:0:18947:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788843413.692805:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:345dfd18-3e4c-44c0-bf46-62bd805326d9:3303:1875737795740544:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788843413.692881:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843413.693001:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795740544 00000100:00100000:1.0:1788843413.693010:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795740544 00000100:00100000:1.0:1788843413.693047:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788843413.693055:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab492f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1875737795740544:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788843413.693082:0:18958:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 345dfd18-3e4c-44c0-bf46-62bd805326d9@0@lo t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:1.0:1788843413.693116:0:18958:0:(genops.c:1385:class_connect()) connect: client 345dfd18-3e4c-44c0-bf46-62bd805326d9, cookie 0xc6b8ac1b09163c8 00000100:00080000:1.0:1788843413.693241:0:18958:0:(import.c:65:import_set_state_nolock()) ffff8dab7c18a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843413.693292:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab492f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+5:3303:x1875737795740544:12345-0@lo:250:mount.lustre.0 Request processed in 236us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843413.693300:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788843413.693373:0:3303:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788843413.693381:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.129@tcp: connect to target with instance 0 00000100:00080000:1.0:1788843413.693389:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788843413.693393:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788843413.693396:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab7c18e000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788843413.693398:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788843413.693406:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788843413.693410:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:345dfd18-3e4c-44c0-bf46-62bd805326d9:3303:1875737795740544:0@lo:250:mount.lustre.0 00000100:00080000:3.0:1788843413.697911:0:18961:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1788843413.707449:0:18947:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843413.708470:0:18947:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788843413.708476:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788843413.709876:0:18947:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788843413.709887:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788843413.710307:0:18947:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788843413.710313:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788843413.711117:0:18947:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788843413.711306:0:18947:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788843413.711311:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788843413.717452:0:18947:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788843413.717464:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788843413.783165:0:18947:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788843413.783634:0:18947:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788843413.783641:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788843413.785988:0:18947:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788843413.786001:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788843413.792593:0:18947:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843413.792804:0:18947:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788843413.792809:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788843413.793697:0:18947:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788843413.793706:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788843413.794275:0:18947:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788843413.794611:0:18947:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788843413.794617:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788843413.795186:0:18947:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788843413.795195:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788843413.795856:0:18947:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788843413.796177:0:18947:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788843413.796182:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788843413.805589:0:18947:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788843413.805609:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788843413.830189:0:18947:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843413.830665:0:18947:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788843413.830673:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788843413.835603:0:18947:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788843413.835624:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788843413.836800:0:18947:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788843413.836811:0:18947:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788843413.841154:0:18947:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788843413.841184:0:18947:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788843413.841190:0:18947:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788843413.841308:0:18947:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788843413.841355:0:18947:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.129@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788843413.841360:0:18947:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788843413.841361:0:18947:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788843413.841363:0:18947:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843413.841364:0:18947:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843413.841365:0:18947:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843413.841366:0:18947:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843413.841368:0:18947:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788843413.841369:0:18947:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788843413.841371:0:18947:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843413.841372:0:18947:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788843413.841374:0:18947:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788843413.841376:0:18947:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788843413.841377:0:18947:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788843413.841378:0:18947:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843413.841379:0:18947:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843413.841380:0:18947:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843413.841381:0:18947:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843413.841382:0:18947:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788843413.841383:0:18947:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788843413.841384:0:18947:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843413.841385:0:18947:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788843413.841408:0:18947:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788843413.841426:0:18947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795740672:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788843413.841632:0:18947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843413.841701:0:18947:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab61d6a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788843413.841723:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795740672 00000100:00100000:3.0:1788843413.841729:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795740672 00000100:00100000:3.0:1788843413.841768:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843413.841776:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab492f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+5:18947:x1875737795740672:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788843413.841819:0:18960:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788843413.841822:0:18960:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788843413.841829:0:18960:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788843413.842221:0:18981:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788843413.842598:0:18960:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:0.0:1788843413.843535:0:18982:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788843413.843541:0:18982:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788843413.843544:0:18982:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788843413.843579:0:18982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788843413.843876:0:18960:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788843413.843885:0:18960:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788843413.849537:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab492f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+5:18947:x1875737795740672:12345-0@lo:253:mount.lustre.0 Request processed in 7753us (8031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843413.849552:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843413.849676:0:18947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795740672:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788843413.849692:0:18947:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788843413.849696:0:18947:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788843413.849697:0:18947:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788843413.849699:0:18947:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843413.849701:0:18947:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843413.849702:0:18947:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843413.849703:0:18947:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843413.849704:0:18947:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788843413.849706:0:18947:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788843413.849708:0:18947:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843413.849709:0:18947:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788843413.849730:0:18947:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dab7c18f800 from lustre-MDT0000 10000000:01000000:0.0:1788843413.849753:0:18947:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788843413.849756:0:18947:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788843413.849760:0:18947:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8dab6f873370 10000000:01000000:0.0:1788843413.849764:0:18947:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788843413.849771:0:18947:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dab6f873370 from 1 10000000:01000000:0.0:1788843413.849774:0:18947:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788843413.849809:0:18947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8daa42696800/0xc6b8ac1b09163cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843413.849820:0:18947:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8daa42696800/0xc6b8ac1b09163cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843413.849830:0:18947:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8daa42696800/0xc6b8ac1b09163cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843413.849849:0:18947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795740800:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788843413.849882:0:18947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843413.849919:0:18947:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab47f73b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843413.849982:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795740800 00000100:00100000:1.0:1788843413.849988:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795740800 00000100:00100000:1.0:1788843413.850065:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788843413.850075:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab492f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+5:18947:x1875737795740800:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843413.850086:0:18959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843413.850100:0:18959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab821c5600/0xc6b8ac1b09163d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b09163cf expref: -99 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843413.850121:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab821c5600/0xc6b8ac1b09163d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b09163cf expref: 6 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843413.850131:0:18959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab821c5600/0xc6b8ac1b09163d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b09163cf expref: 6 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843413.850139:0:18959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c5600, rc 0) 00000100:00100000:1.0:1788843413.850178:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab492f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+6:18947:x1875737795740800:12345-0@lo:101:mount.lustre.0 Request processed in 106us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843413.850198:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843413.850255:0:18947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795740800:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843413.850274:0:18947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8daa42696800/0xc6b8ac1b09163cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09163d6 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843413.850282:0:18947:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8daa42696800/0xc6b8ac1b09163cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b09163d6 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843413.850325:0:18947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795740928:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843413.850374:0:18947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843413.855204:0:18947:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab47f73b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843413.855281:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795740928 00000100:00100000:3.0:1788843413.855291:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795740928 00000100:00100000:3.0:1788843413.855407:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843413.855419:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab492f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+6:18947:x1875737795740928:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843413.855742:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab492f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+6:18947:x1875737795740928:12345-0@lo:501:mount.lustre.0 Request processed in 325us (5366us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788843413.855761:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843413.856080:0:18947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795740928:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788843413.856192:0:18947:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788843413.856250:0:18947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8daa42696800/0xc6b8ac1b09163cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09163d6 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843413.856262:0:18947:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8daa42696800/0xc6b8ac1b09163cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09163d6 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843413.856272:0:18947:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dab7c18f800 10000000:01000000:1.0:1788843413.856278:0:18947:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788843413.856283:0:18947:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dab7c18f800 10000000:01000000:1.0:1788843413.856285:0:18947:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788843413.856289:0:18947:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dab7c18f800 from 1 10000000:01000000:1.0:1788843413.856291:0:18947:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788843413.856325:0:18947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b09163dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843413.856334:0:18947:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b09163dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843413.856371:0:18947:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b09163dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843413.856392:0:18947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795741056:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788843413.856430:0:18947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843413.856460:0:18947:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4aa68cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843413.856517:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795741056 00000100:00100000:3.0:1788843413.856522:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795741056 00000100:00100000:3.0:1788843413.856558:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843413.856566:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab492f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+6:18947:x1875737795741056:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843413.856576:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843413.856590:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab41532400/0xc6b8ac1b09163e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b09163dd expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843413.856609:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab41532400/0xc6b8ac1b09163e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b09163dd expref: 7 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843413.856619:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab41532400/0xc6b8ac1b09163e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b09163dd expref: 7 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843413.856627:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41532400, rc 0) 00000100:00100000:3.0:1788843413.856672:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab492f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+7:18947:x1875737795741056:12345-0@lo:101:mount.lustre.0 Request processed in 106us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843413.856678:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788843413.856763:0:18947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795741056:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843413.856776:0:18947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b09163dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09163e4 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843413.856785:0:18947:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b09163dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b09163e4 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843413.856797:0:18947:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788843413.856923:0:18947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b09163dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09163e4 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843413.856932:0:18947:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b09163dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09163e4 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843413.856938:0:18947:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788843413.856943:0:18947:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788843413.856947:0:18947:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dab7c18f800 10000000:01000000:0.0:1788843413.856958:0:18947:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788843413.856961:0:18947:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788843413.857044:0:18947:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788843413.857062:0:18947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8daa42697a00/0xc6b8ac1b09163eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843413.857069:0:18947:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8daa42697a00/0xc6b8ac1b09163eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843413.857076:0:18947:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8daa42697a00/0xc6b8ac1b09163eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843413.857088:0:18947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795741184:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788843413.857119:0:18947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843413.857145:0:18947:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab47f73b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843413.857195:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795741184 00000100:00100000:3.0:1788843413.857199:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795741184 00000100:00100000:3.0:1788843413.857231:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843413.857237:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab820e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+7:18947:x1875737795741184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843413.857245:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843413.857255:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab41533e00/0xc6b8ac1b09163f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b09163eb expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843413.857268:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab41533e00/0xc6b8ac1b09163f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b09163eb expref: 8 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843413.857283:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab41533e00/0xc6b8ac1b09163f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b09163eb expref: 8 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843413.857290:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41533e00, rc 0) 00000100:00100000:3.0:1788843413.857466:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab820e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+8:18947:x1875737795741184:12345-0@lo:101:mount.lustre.0 Request processed in 228us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843413.857472:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788843413.858883:0:18947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795741184:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843413.858908:0:18947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8daa42697a00/0xc6b8ac1b09163eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09163f2 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843413.858919:0:18947:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8daa42697a00/0xc6b8ac1b09163eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b09163f2 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843413.859155:0:18947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795741312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843413.859198:0:18947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843413.859233:0:18947:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab47f73b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843413.859291:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795741312 00000100:00100000:1.0:1788843413.859297:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795741312 00000100:00100000:1.0:1788843413.859368:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843413.859389:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab820e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+8:18947:x1875737795741312:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843413.860184:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab820e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+9:18947:x1875737795741312:12345-0@lo:501:mount.lustre.0 Request processed in 795us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843413.860192:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843413.860265:0:18947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795741312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843413.860298:0:18947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795741440:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843413.860334:0:18947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843413.860500:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795741440 00000100:00100000:3.0:1788843413.860506:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795741440 00000100:00100000:3.0:1788843413.860547:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788843413.860555:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab820e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+9:18947:x1875737795741440:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843413.860641:0:18947:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab47f73b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843413.860879:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab820e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+9:18947:x1875737795741440:12345-0@lo:503:mount.lustre.0 Request processed in 324us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843413.860886:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843413.861050:0:18947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795741440:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843413.861424:0:18983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:345dfd18-3e4c-44c0-bf46-62bd805326d9:18983:1875737795741568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843413.861464:0:18983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843413.861524:0:18983:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab47f736c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843413.861555:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795741568 00000100:00100000:1.0:1788843413.861560:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795741568 00000100:00100000:1.0:1788843413.861626:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843413.861634:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+9:18983:x1875737795741568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843413.861886:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+9:18983:x1875737795741568:12345-0@lo:502:llog_process_th.0 Request processed in 252us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843413.861893:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788843413.861974:0:18983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:345dfd18-3e4c-44c0-bf46-62bd805326d9:18983:1875737795741568:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788843413.861996:0:18983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843413.862007:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843413.862009:0:18983:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788843413.862014:0:18983:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788843413.862017:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788843413.862031:0:18983:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8dab77ac4d28) 00000020:00000080:0.0:1788843413.862047:0:18983:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788843413.862053:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788843413.862121:0:18983:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788843413.862129:0:18983:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b0916400 00000020:00000080:0.0:1788843413.862395:0:18983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788843413.862400:0:18983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843413.862403:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843413.862405:0:18983:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788843413.862408:0:18983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843413.862411:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843413.862412:0:18983:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788843413.862416:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788843413.862424:0:18983:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8dab77ac3370) 00000020:00000080:0.0:1788843413.862434:0:18983:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788843413.862437:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788843413.862439:0:18983:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788843413.862441:0:18983:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788843413.862446:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788843413.862480:0:18983:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dab7c18f800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788843413.862492:0:18983:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8dab77ac0000) 00000020:00000080:0.0:1788843413.862502:0:18983:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788843413.862565:0:18983:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788843413.862572:0:18983:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b8ac1b0916415 00000020:00000080:0.0:1788843413.862669:0:18983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788843413.862675:0:18983:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788843413.862680:0:18983:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc6b8ac1b091641c 00080000:01000000:0.0:1788843413.862685:0:18983:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788843413.862688:0:18983:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b0916423 00010000:00010000:2.0:1788843413.932195:0:18983:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788843413.932666:0:18983:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:2.0:1788843413.932836:0:18983:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788843413.933289:0:18983:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8dab440e99b8) 00000020:00000080:2.0:1788843413.933306:0:18983:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788843413.933385:0:18983:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788843413.933395:0:18983:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b0916431 00000020:00000080:3.0:1788843413.941309:0:18983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788843413.948997:0:18983:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc6b8ac1b0916438 00000020:00000080:0.0:1788843413.957312:0:18983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788843413.957326:0:18983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843413.957336:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843413.957338:0:18983:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788843413.957361:0:18983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788843413.957364:0:18983:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1788843413.957365:0:18983:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788843413.957367:0:18983:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788843413.957368:0:18983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788843413.957371:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843413.957372:0:18983:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788843413.957375:0:18983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843413.957379:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843413.957381:0:18983:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788843413.957385:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788843413.957433:0:18983:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788843413.957448:0:18983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843413.957451:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843413.957453:0:18983:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788843413.957456:0:18983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788843413.957459:0:18983:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788843413.957462:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843413.957464:0:18983:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788843413.957467:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788843413.957472:0:18983:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:0.0:1788843413.957516:0:18983:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788843413.957527:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788843413.957543:0:18983:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8dab77ac19b8) 00000020:00000080:0.0:1788843413.957562:0:18983:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788843413.957568:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788843413.957655:0:18983:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788843413.957662:0:18983:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788843413.957670:0:18983:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b0916446 00010000:00080000:0.0:1788843413.957703:0:18983:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dab51a7b000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:0.0:1788843413.957933:0:18983:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788843413.958652:0:18983:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788843413.958709:0:18983:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788843413.960748:0:18983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788843413.960907:0:18983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1788843413.960998:0:18983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1788843413.966320:0:18987:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788843413.966328:0:18987:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788843413.977444:0:18983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788843413.977463:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788843413.977503:0:18983:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788843413.977523:0:18983:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b8ac1b091644d 00000100:00080000:2.0:1788843413.977533:0:18983:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788843413.977539:0:18983:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dab51a7b000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1788843413.977594:0:18983:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab73a7ad80 x1875737795741696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843413.977627:0:18983:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788843413.977704:0:18983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843413.977708:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843413.977710:0:18983:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788843413.977714:0:18983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788843413.977716:0:18983:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788843413.977718:0:18983:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788843413.977719:0:18983:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788843413.977721:0:18983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788843413.977723:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843413.977725:0:18983:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788843413.977727:0:18983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788843413.977731:0:18983:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788843413.977733:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843413.977734:0:18983:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788843413.977744:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788843413.977748:0:18983:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:2.0:1788843413.977772:0:18983:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788843413.977775:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788843413.977787:0:18983:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8dab440eb370) 00000020:00000080:2.0:1788843413.977798:0:18983:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788843413.977803:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788843413.977859:0:18983:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788843413.977865:0:18983:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788843413.977870:0:18983:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b091645b 00010000:00080000:2.0:1788843413.977900:0:18983:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dab7772f800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.129@tcp at head 00000100:00100000:1.0:1788843413.978127:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795741696:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788843413.978177:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875737795741696 offset 0 length 520: 4 00010000:00010000:2.0:1788843413.978846:0:18983:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788843413.979055:0:18983:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788843413.979080:0:18983:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788843413.979827:0:18983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843413.979899:0:18983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788843413.979986:0:18983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1788843413.984925:0:18989:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788843413.984934:0:18989:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788843413.985839:0:18983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788843413.985852:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788843413.985889:0:18983:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788843413.985910:0:18983:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b8ac1b0916462 00000100:00080000:3.0:1788843413.985924:0:18983:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788843413.985930:0:18983:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dab7772f800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1788843413.985971:0:18983:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab43783b80 x1875737795741824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788843413.986012:0:18983:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788843413.986089:0:18983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:1.0:1788843413.986092:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795741824:0@lo:8:llog_process_th.0 00000020:00000080:3.0:1788843413.986093:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843413.986095:0:18983:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788843413.986098:0:18983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843413.986101:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843413.986102:0:18983:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788843413.986105:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788843413.986107:0:18983:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788843413.986108:0:18983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843413.986110:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843413.986111:0:18983:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788843413.986113:0:18983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843413.986115:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843413.986116:0:18983:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788843413.986119:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000400:00000100:1.0:1788843413.986143:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875737795741824 offset 0 length 520: 4 00000100:00100000:3.0:1788843413.986144:0:18983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43780380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:345dfd18-3e4c-44c0-bf46-62bd805326d9:18983:1875737795741952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843413.986189:0:18983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843413.986206:0:18983:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab48baea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843413.986214:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795741952 00000100:00100000:1.0:1788843413.986220:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795741952 00000100:00100000:1.0:1788843413.986263:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788843413.986272:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+9:18983:x1875737795741952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843413.986540:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+9:18983:x1875737795741952:12345-0@lo:502:llog_process_th.0 Request processed in 268us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843413.986548:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788843413.986657:0:18983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43780380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:345dfd18-3e4c-44c0-bf46-62bd805326d9:18983:1875737795741952:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788843413.986683:0:18983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843413.986687:0:18983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843413.986689:0:18983:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788843413.986692:0:18983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788843413.986836:0:18947:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788843413.986854:0:18947:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788843413.986876:0:18947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8daa42697a00/0xc6b8ac1b09163eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09163f2 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843413.986887:0:18947:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8daa42697a00/0xc6b8ac1b09163eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09163f2 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843413.986894:0:18947:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dab7c18f800 from 1 10000000:01000000:1.0:1788843413.986897:0:18947:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788843413.986924:0:18947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0916469 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843413.986931:0:18947:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0916469 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843413.986939:0:18947:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0916469 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843413.986953:0:18947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795742080:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788843413.987114:0:18947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843413.987144:0:18947:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab61fd1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843413.987197:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795742080 00000100:00100000:3.0:1788843413.987202:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795742080 00000100:00100000:3.0:1788843413.987235:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788843413.987252:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+9:18947:x1875737795742080:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843413.987262:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843413.987282:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab41532200/0xc6b8ac1b0916470 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0916469 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843413.987304:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab41532200/0xc6b8ac1b0916470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0916469 expref: 10 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843413.987314:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab41532200/0xc6b8ac1b0916470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0916469 expref: 10 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843413.987322:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41532200, rc 0) 00000100:00100000:3.0:1788843413.987383:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+10:18947:x1875737795742080:12345-0@lo:101:mount.lustre.0 Request processed in 140us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843413.987390:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788843413.987600:0:18947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795742080:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843413.987614:0:18947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0916469 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916470 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843413.987623:0:18947:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0916469 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0916470 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843413.993444:0:18947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795742208:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788843413.993575:0:18947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843413.993624:0:18947:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab47f73540 going to sleep for 11 seconds 00000100:00100000:1.0:1788843413.993737:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795742208 00000100:00100000:1.0:1788843413.993751:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795742208 00000100:00100000:1.0:1788843413.993808:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788843413.993818:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+10:18947:x1875737795742208:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788843413.993838:0:18959:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788843413.993844:0:18959:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788843413.993922:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+10:18947:x1875737795742208:12345-0@lo:256:mount.lustre.0 Request processed in 105us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843413.993930:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788843413.994076:0:18947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795742208:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788843413.994696:0:18947:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788843413.994721:0:18947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0916469 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916470 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843413.994733:0:18947:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0916469 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916470 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843413.994742:0:18947:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab7c18f800 from 1 10000000:01000000:0.0:1788843413.994745:0:18947:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788843413.994783:0:18947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8daa42697c00/0xc6b8ac1b0916477 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843413.994791:0:18947:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8daa42697c00/0xc6b8ac1b0916477 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843413.994800:0:18947:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8daa42697c00/0xc6b8ac1b0916477 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843413.994816:0:18947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795742336:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788843413.994852:0:18947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843413.994881:0:18947:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab47f73540 going to sleep for 11 seconds 00000100:00100000:3.0:1788843413.994957:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795742336 00000100:00100000:3.0:1788843413.994974:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795742336 00000100:00100000:3.0:1788843413.995013:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788843413.995021:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+10:18947:x1875737795742336:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843413.995031:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843413.995045:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab41533400/0xc6b8ac1b091647e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0916477 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843413.995067:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab41533400/0xc6b8ac1b091647e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0916477 expref: 11 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843413.995078:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab41533400/0xc6b8ac1b091647e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0916477 expref: 11 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843413.995085:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41533400, rc 0) 00000100:00100000:3.0:1788843413.995119:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+11:18947:x1875737795742336:12345-0@lo:101:mount.lustre.0 Request processed in 99us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843413.995136:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788843413.995306:0:18947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795742336:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843413.995318:0:18947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8daa42697c00/0xc6b8ac1b0916477 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b091647e expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843413.995327:0:18947:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8daa42697c00/0xc6b8ac1b0916477 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b091647e expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843413.995401:0:18947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795742464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843413.995429:0:18947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843413.995454:0:18947:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab47f73540 going to sleep for 11 seconds 00000100:00100000:1.0:1788843413.995528:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795742464 00000100:00100000:1.0:1788843413.995533:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795742464 00000100:00100000:1.0:1788843413.995565:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788843413.995573:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+11:18947:x1875737795742464:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843413.995939:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+11:18947:x1875737795742464:12345-0@lo:501:mount.lustre.0 Request processed in 367us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843413.995946:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788843413.996310:0:18947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795742464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843413.996379:0:18947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795742592:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843413.996423:0:18947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843413.996447:0:18947:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab47f73540 going to sleep for 11 seconds 00000100:00100000:2.0:1788843413.996632:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795742592 00000100:00100000:2.0:1788843413.996638:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795742592 00000100:00100000:2.0:1788843413.996684:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788843413.996693:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+11:18947:x1875737795742592:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843413.996870:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+11:18947:x1875737795742592:12345-0@lo:503:mount.lustre.0 Request processed in 178us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843413.996877:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788843413.996922:0:18947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795742592:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843413.997325:0:18991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:345dfd18-3e4c-44c0-bf46-62bd805326d9:18991:1875737795742720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843413.997406:0:18991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843413.997433:0:18991:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab47f73f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843413.997500:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795742720 00000100:00100000:3.0:1788843413.997506:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795742720 00000100:00100000:3.0:1788843413.997543:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788843413.997551:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+11:18991:x1875737795742720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843413.997756:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+11:18991:x1875737795742720:12345-0@lo:502:llog_process_th.0 Request processed in 205us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843413.997764:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788843413.997892:0:18991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:345dfd18-3e4c-44c0-bf46-62bd805326d9:18991:1875737795742720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788843413.997916:0:18991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843413.997924:0:18991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843413.997927:0:18991:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788843413.997933:0:18991:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dab7c18f800 00000020:00000080:0.0:1788843413.997936:0:18991:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788843413.997943:0:18991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843413.997945:0:18991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843413.997947:0:18991:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788843413.997949:0:18991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843413.997951:0:18991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843413.997953:0:18991:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788843413.997956:0:18991:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dab7c18f800 00000020:00000080:0.0:1788843413.997959:0:18991:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788843413.998024:0:18991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843413.998028:0:18991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843413.998030:0:18991:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788843413.998032:0:18991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843413.998035:0:18991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843413.998036:0:18991:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788843413.998040:0:18991:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dab7c18f800 00000020:00000080:0.0:1788843413.998042:0:18991:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788843413.998076:0:18991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:345dfd18-3e4c-44c0-bf46-62bd805326d9:18991:1875737795742848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843413.998112:0:18991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843413.998141:0:18991:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab47f73f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843413.998160:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795742848 00000100:00100000:2.0:1788843413.998164:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795742848 00000100:00100000:2.0:1788843413.998202:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843413.998208:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+11:18991:x1875737795742848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843413.998334:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+11:18991:x1875737795742848:12345-0@lo:502:llog_process_th.0 Request processed in 126us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843413.998367:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788843414.001829:0:18991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:345dfd18-3e4c-44c0-bf46-62bd805326d9:18991:1875737795742848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788843414.001886:0:18991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843414.001893:0:18991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843414.001896:0:18991:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788843414.001900:0:18991:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788843414.004712:0:18947:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788843414.004751:0:18947:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788843414.004773:0:18947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8daa42697c00/0xc6b8ac1b0916477 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b091647e expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.004787:0:18947:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8daa42697c00/0xc6b8ac1b0916477 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b091647e expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843414.004852:0:18947:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788843414.004855:0:18947:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dab7c18f800 10000000:01000000:3.0:1788843414.004858:0:18947:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dab7c18f800 10000000:01000000:3.0:1788843414.004862:0:18947:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788843414.004867:0:18947:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dab7c18f800 from 1 10000000:01000000:3.0:1788843414.004870:0:18947:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788843414.004911:0:18947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0916485 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.004920:0:18947:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0916485 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.004931:0:18947:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0916485 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843414.004960:0:18947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43780380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795742976:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788843414.005021:0:18947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843414.005061:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795742976 00000100:00100000:3.0:1788843414.005068:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795742976 00000100:00100000:3.0:1788843414.005110:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788843414.005119:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+11:18947:x1875737795742976:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843414.005132:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843414.005145:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab41532e00/0xc6b8ac1b091648c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0916485 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.005168:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab41532e00/0xc6b8ac1b091648c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0916485 expref: 12 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.005178:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab41532e00/0xc6b8ac1b091648c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0916485 expref: 12 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.005186:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41532e00, rc 0) 00000100:00100000:3.0:1788843414.005218:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:18947:x1875737795742976:12345-0@lo:101:mount.lustre.0 Request processed in 100us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843414.005225:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788843414.005265:0:18947:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4a886c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843414.005286:0:18947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43780380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795742976:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843414.005300:0:18947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0916485 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b091648c expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.005309:0:18947:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0916485 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b091648c expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843414.005384:0:18947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43780380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795743104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843414.005411:0:18947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843414.005433:0:18947:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4a886c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843414.005532:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795743104 00000100:00100000:2.0:1788843414.005537:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795743104 00000100:00100000:2.0:1788843414.005563:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788843414.005570:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:18947:x1875737795743104:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843414.005849:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:18947:x1875737795743104:12345-0@lo:501:mount.lustre.0 Request processed in 278us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843414.005853:0:18947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43780380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795743104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843414.005856:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788843414.005880:0:18947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43780380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795743232:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843414.005916:0:18947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843414.005941:0:18947:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4a886c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843414.006019:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795743232 00000100:00100000:2.0:1788843414.006023:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795743232 00000100:00100000:2.0:1788843414.006046:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788843414.006065:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:18947:x1875737795743232:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843414.006232:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:18947:x1875737795743232:12345-0@lo:503:mount.lustre.0 Request processed in 179us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843414.006239:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788843414.006397:0:18947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43780380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795743232:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843414.006956:0:18996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43780380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:345dfd18-3e4c-44c0-bf46-62bd805326d9:18996:1875737795743360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843414.007000:0:18996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843414.007034:0:18996:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4a886c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843414.007132:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795743360 00000100:00100000:2.0:1788843414.007137:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795743360 00000100:00100000:2.0:1788843414.007173:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788843414.007180:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:18996:x1875737795743360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843414.007403:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:18996:x1875737795743360:12345-0@lo:502:llog_process_th.0 Request processed in 223us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843414.007411:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788843414.007659:0:18996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43780380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:345dfd18-3e4c-44c0-bf46-62bd805326d9:18996:1875737795743360:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788843414.007715:0:18996:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788843414.007731:0:18996:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8dab7f7119b8) 00000020:00000080:3.0:1788843414.007749:0:18996:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788843414.007904:0:18996:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dab7c18f800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788843414.007908:0:18996:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dab7c18f800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788843414.007911:0:18996:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab7c18f800 4 00010000:00080000:3.0:1788843414.007937:0:18996:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dab7772b800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:3.0:1788843414.013425:0:18996:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788843414.014232:0:18996:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788843414.014268:0:18996:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788843414.014280:0:18996:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc6b8ac1b091649a 00000100:00080000:3.0:1788843414.014289:0:18996:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788843414.014300:0:18996:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dab7772b800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1788843414.014335:0:18996:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab43780380 x1875737795743488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788843414.014401:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875737795743488:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788843414.014476:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788843414.015621:0:18996:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788843414.016617:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795743488 00000100:00100000:0.0:1788843414.016629:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795743488 00000100:00100000:0.0:1788843414.020383:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843414.020395:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875737795743488:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788843414.020503:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875737795743488:12345-0@lo:38:llog_process_th.0 Request processed in 108us (6026us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788843414.020511:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843414.025873:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788843414.025885:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab7772b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788843414.025892:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788843414.025897:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875737795743488:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788843414.026441:0:18996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a78e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:345dfd18-3e4c-44c0-bf46-62bd805326d9:18996:1875737795743616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843414.027042:0:18996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843414.027096:0:18996:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69839d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788843414.027151:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795743616 00000100:00100000:3.0:1788843414.027158:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795743616 00000100:00100000:3.0:1788843414.027203:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788843414.027212:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:18996:x1875737795743616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843414.027489:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:18996:x1875737795743616:12345-0@lo:502:llog_process_th.0 Request processed in 277us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843414.027515:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788843414.027566:0:18996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a78e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:345dfd18-3e4c-44c0-bf46-62bd805326d9:18996:1875737795743616:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788843414.027590:0:18996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788843414.027966:0:18947:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788843414.027988:0:18947:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788843414.028008:0:18947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0916485 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b091648c expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843414.028019:0:18947:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0916485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b091648c expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788843414.028073:0:18947:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788843414.028076:0:18947:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788843414.028077:0:18947:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843414.028078:0:18947:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843414.028079:0:18947:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843414.028080:0:18947:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843414.028082:0:18947:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788843414.028083:0:18947:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788843414.028085:0:18947:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843414.028086:0:18947:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788843414.028090:0:18947:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788843414.028092:0:18947:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788843414.028094:0:18947:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788843414.028095:0:18947:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843414.028095:0:18947:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843414.028096:0:18947:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843414.028097:0:18947:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843414.028098:0:18947:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788843414.028099:0:18947:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788843414.028100:0:18947:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843414.028102:0:18947:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788843414.028119:0:18947:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788843414.028131:0:18947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795743744:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788843414.028169:0:18947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843414.028191:0:18947:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69839780 going to sleep for 11 seconds 00000100:00100000:3.0:1788843414.029894:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795743744 00000100:00100000:3.0:1788843414.029905:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795743744 00000100:00100000:3.0:1788843414.029947:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788843414.029955:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:18947:x1875737795743744:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788843414.029986:0:18960:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788843414.030000:0:18960:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788843414.101895:0:18960:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788843414.101936:0:18960:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788843414.105119:0:18981:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788843414.105128:0:18981:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788843414.105150:0:18981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b09164a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843414.105169:0:18981:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab41532200/0xc6b8ac1b0916470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0916469 expref: 12 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843414.105178:0:18981:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b09164a1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843414.105218:0:18981:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab41532200/0xc6b8ac1b0916470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0916469 expref: 12 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843414.105232:0:18981:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab41532200/0xc6b8ac1b0916470 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0916469 expref: 12 pid: 18958 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843414.105260:0:18981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18981:1875737795743872:0@lo:104: 00000100:00100000:1.0:1788843414.105321:0:18981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843414.105393:0:18981:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab436f0240 going to sleep for 11 seconds 00000100:00100000:3.0:1788843414.105468:0:18948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795743872 00000100:00100000:3.0:1788843414.105475:0:18948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795743872 00000100:00100000:3.0:1788843414.105520:0:18948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843414.105529:0:18948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:345dfd18-3e4c-44c0-bf46-62bd805326d9+3:18981:x1875737795743872:12345-0@lo:104: 00010000:00010000:3.0:1788843414.105541:0:18948:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0916469 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0916470 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.105595:0:18948:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788843414.105601:0:18948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:345dfd18-3e4c-44c0-bf46-62bd805326d9+3:18981:x1875737795743872:12345-0@lo:104: Request processed in 74us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843414.105607:0:18948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788843414.105627:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843414.105633:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0916469 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0916470 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.105641:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4a00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843414.105653:0:18954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0916469 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0916470 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.105662:0:18954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0916469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0916470 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843414.105670:0:18954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0916469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0916470 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843414.105676:0:18954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788843414.105700:0:18954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0916469 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0916470 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.105716:0:18954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843414.105736:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0916469 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0916470 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.105743:0:18954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0916469 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0916470 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.105759:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843414.105761:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843414.105763:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843414.105792:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:345dfd18-3e4c-44c0-bf46-62bd805326d9:3304:1875737795744000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843414.105821:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843414.105871:0:18950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795744000 00000100:00100000:3.0:1788843414.105875:0:18950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795744000 00010000:00010000:3.0:1788843414.105890:0:18950:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab41532200/0xc6b8ac1b0916470 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0916469 expref: 13 pid: 18958 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843414.105911:0:18950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843414.105917:0:18950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:345dfd18-3e4c-44c0-bf46-62bd805326d9+13:3304:x1875737795744000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843414.105926:0:18950:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843414.105930:0:18950:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab41532200/0xc6b8ac1b0916470 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0916469 expref: 13 pid: 18958 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.105940:0:18950:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab41532200/0xc6b8ac1b0916470 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0916469 expref: 13 pid: 18958 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.105955:0:18950:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b09164a1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.105986:0:18950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b09164a1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788843414.105999:0:18950:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000871355s 00010000:00010000:3.0:1788843414.106003:0:18950:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b09164a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.106011:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b09164a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.106017:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b09164a1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.106023:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b09164a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.106029:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843414.106033:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b09164a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.106040:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b09164a1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.106048:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b09164a1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843414.106057:0:18950:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843414.106088:0:18950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:345dfd18-3e4c-44c0-bf46-62bd805326d9+13:3304:x1875737795744000:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843414.106094:0:18950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843414.106134:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:345dfd18-3e4c-44c0-bf46-62bd805326d9:3304:1875737795744000:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843414.106258:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab41532200/0xc6b8ac1b0916470 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0916469 expref: 12 pid: 18958 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843414.106269:0:18981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18981:1875737795743872:0@lo:104: 00010000:00010000:1.0:1788843414.106280:0:18981:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b09164a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843414.106288:0:18981:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b09164a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843414.106294:0:18981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b09164a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843414.106299:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b09164a1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843414.111376:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+11:18947:x1875737795743744:12345-0@lo:253:mount.lustre.0 Request processed in 81412us (83196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843414.111390:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788843414.111488:0:18947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:18947:1875737795743744:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788843414.111578:0:18947:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788843414.111593:0:18947:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788843414.111595:0:18947:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788843414.111596:0:18947:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843414.111597:0:18947:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843414.111598:0:18947:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843414.111599:0:18947:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843414.111600:0:18947:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788843414.111602:0:18947:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788843414.111603:0:18947:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843414.111604:0:18947:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788843414.111619:0:18947:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788843414.116992:0:18947:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788843414.117236:0:18947:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788843414.117832:0:18947:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788843414.118001:0:18947:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788843414.118570:0:18947:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788843414.118838:0:18947:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788843414.120288:0:18947:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788843414.120603:0:18947:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788843414.121046:0:18947:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788843414.121470:0:18947:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788843414.121838:0:18947:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788843414.121971:0:18947:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788843414.172997:0:18947:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967528 00000040:01000000:2.0:1788843414.173481:0:18947:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788843414.173739:0:19004:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967528 00000020:00080000:0.0:1788843414.173743:0:19004:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000040:01000000:3.0:1788843414.174021:0:19005:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788843414.174158:0:19005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843414.176790:0:19005:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788843414.176867:0:19005:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788843414.176871:0:19005:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1788843414.181810:0:18947:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788843414.181943:0:18947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788843414.182749:0:18947:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788843414.182760:0:18947:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788843414.182902:0:18947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843414.184325:0:18947:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788843414.184924:0:18947:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788843414.184953:0:18947:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788843414.185417:0:18947:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1788843414.186285:0:18947:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:2.0:1788843414.195933:0:18947:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1788843414.235679:0:18947:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788843414.235717:0:18947:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa9b2c168f988 00100000:10000000:3.0:1788843414.235725:0:18947:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788843414.236745:0:18947:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788843414.236760:0:18947:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788843414.236773:0:18947:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788843414.236789:0:18947:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788843414.724694:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788843414.981025:0:18962:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788843414.981032:0:18962:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dab7c18f800 from 9 10000000:01000000:0.0:1788843414.981038:0:18962:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788843414.981083:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8daa42696400/0xc6b8ac1b09164a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843414.981094:0:18962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8daa42696400/0xc6b8ac1b09164a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843414.981105:0:18962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8daa42696400/0xc6b8ac1b09164a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843414.981129:0:18962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795744128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843414.981198:0:18962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843414.981268:0:18962:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7793a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843414.982325:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795744128 00000100:00100000:2.0:1788843414.982334:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795744128 00000100:00100000:2.0:1788843414.982393:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788843414.982401:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+11:18962:x1875737795744128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843414.982416:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843414.982432:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7ff88400/0xc6b8ac1b09164af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b09164a8 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843414.982454:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff88400/0xc6b8ac1b09164af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b09164a8 expref: 12 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843414.982464:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7ff88400/0xc6b8ac1b09164af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b09164a8 expref: 12 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843414.982472:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88400, rc 0) 00000100:00100000:2.0:1788843414.982529:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:18962:x1875737795744128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843414.982536:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788843414.982585:0:18962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795744128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843414.982599:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8daa42696400/0xc6b8ac1b09164a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09164af expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843414.982608:0:18962:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8daa42696400/0xc6b8ac1b09164a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b09164af expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843414.982683:0:18962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795744256:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788843414.982716:0:18962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843414.982732:0:18962:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4386d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788843414.982745:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795744256 00000100:00100000:2.0:1788843414.982748:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795744256 00000100:00100000:2.0:1788843414.982765:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788843414.982770:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:18962:x1875737795744256:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788843414.982782:0:18960:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788843414.982795:0:18960:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788843414.982798:0:18960:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788843414.982862:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:18962:x1875737795744256:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 91us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843414.982869:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788843414.982895:0:18962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795744256:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788843414.982930:0:18962:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788843414.982937:0:18962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8daa42696400/0xc6b8ac1b09164a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09164af expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843414.982945:0:18962:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8daa42696400/0xc6b8ac1b09164a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09164af expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788843415.045690:0:18997:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788843415.045701:0:18997:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788843415.046080:0:18997:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788843415.046088:0:18997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788843415.751367:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843416.075821:0:18997:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788843416.075831:0:18997:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788843416.076236:0:18997:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1788843416.076305:0:18997:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788843416.076338:0:18997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:2.0:1788843416.773405:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843417.801700:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843418.821604:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788843419.148839:0:19248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1788843419.465286:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843419.465292:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788843419.465295:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843419.465298:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788843419.465300:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788843419.465304:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788843419.465308:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dab7772b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788843419.465319:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dab7772b800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1788843419.465370:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab7cd41c00 x1875737795744512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843419.465505:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:345dfd18-3e4c-44c0-bf46-62bd805326d9:3305:1875737795744384:0@lo:400:kworker.0 00000100:00100000:0.0:1788843419.465643:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843419.465707:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875737795744512:0@lo:38:kworker.0 00000100:00100000:0.0:1788843419.465738:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843419.465778:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795744384 00000100:00100000:0.0:1788843419.465786:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795744384 00000100:00100000:0.0:1788843419.465829:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788843419.465839:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:3305:x1875737795744384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843419.465904:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:3305:x1875737795744384:12345-0@lo:400:kworker.0 Request processed in 66us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843419.465912:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788843419.465968:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:345dfd18-3e4c-44c0-bf46-62bd805326d9:3305:1875737795744384:0@lo:400:kworker.0 00000100:00100000:2.0:1788843419.471604:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795744512 00000100:00100000:2.0:1788843419.471629:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795744512 00000100:00100000:2.0:1788843419.471680:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788843419.471688:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875737795744512:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788843419.471716:0:18967:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:2.0:1788843419.471750:0:18967:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc6b8ac1b09164b6 00000004:00100000:2.0:1788843419.471766:0:18967:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788843419.471894:0:18967:0:(import.c:65:import_set_state_nolock()) ffff8dab7fcf3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843419.471995:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875737795744512:12345-0@lo:38:kworker.0 Request processed in 305us (6254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843419.472184:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788843419.472297:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dab7cd41c00 x1875737795744512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788843419.472313:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788843419.472321:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788843419.472326:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788843419.472329:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab7772b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788843419.472335:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875737795744512:0@lo:38:kworker.0 00010000:00010000:2.0:1788843419.847758:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843420.868506:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843421.892625:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788843422.618856:0:19399:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdbac82ff0 20000000:00000080:3.0:1788843422.618871:0:19399:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dab5db36000 uarg=0000000000000000 20000000:01000000:3.0:1788843422.618901:0:19399:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788843422.618907:0:19399:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788843422.618912:0:19399:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788843422.619864:0:19400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788843422.620093:0:19399:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788843422.627165:0:19399:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788843422.627200:0:19399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b09164bd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843422.627218:0:19399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab41533400/0xc6b8ac1b091647e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0916477 expref: 11 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843422.627226:0:19399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b09164bd lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843422.627288:0:19399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab41533400/0xc6b8ac1b091647e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0916477 expref: 11 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843422.627305:0:19399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab41533400/0xc6b8ac1b091647e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0916477 expref: 11 pid: 18958 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843422.627322:0:19399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43780380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19399:1875737795744640:0@lo:104: 00000100:00100000:3.0:1788843422.627438:0:19399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843422.627504:0:19399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab61d6a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788843422.627971:0:18949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795744640 00000100:00100000:0.0:1788843422.627979:0:18949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795744640 00000100:00100000:0.0:1788843422.628036:0:18949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843422.628046:0:18949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:345dfd18-3e4c-44c0-bf46-62bd805326d9+3:19399:x1875737795744640:12345-0@lo:104: 00010000:00010000:0.0:1788843422.628059:0:18949:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8daa42697c00/0xc6b8ac1b0916477 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b091647e expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843422.628139:0:18949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788843422.628321:0:19399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43780380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19399:1875737795744640:0@lo:104: 00010000:00010000:1.0:1788843422.628365:0:19399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b09164bd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843422.628447:0:18949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:345dfd18-3e4c-44c0-bf46-62bd805326d9+3:19399:x1875737795744640:12345-0@lo:104: Request processed in 102us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843422.628456:0:18949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788843422.628478:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843422.628484:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8daa42697c00/0xc6b8ac1b0916477 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b091647e expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843422.628491:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42697c00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:0.0:1788843422.628495:0:18953:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8daa42697c00/0xc6b8ac1b0916477 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b091647e expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843422.628502:0:18953:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8daa42697c00/0xc6b8ac1b0916477 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b091647e expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843422.628509:0:18953:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8daa42697c00/0xc6b8ac1b0916477 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b091647e expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843422.628522:0:18953:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788843422.628557:0:18953:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8daa42697c00/0xc6b8ac1b0916477 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b091647e expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843422.628564:0:18953:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843422.628779:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8daa42697c00/0xc6b8ac1b0916477 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b091647e expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843422.628788:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8daa42697c00/0xc6b8ac1b0916477 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b091647e expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843422.628805:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843422.628807:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843422.628809:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843422.628858:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843422.628870:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:345dfd18-3e4c-44c0-bf46-62bd805326d9:3307:1875737795744768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843422.628914:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843422.629089:0:18950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795744768 00000100:00100000:0.0:1788843422.629094:0:18950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795744768 00010000:00010000:0.0:1788843422.629115:0:18950:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab41533400/0xc6b8ac1b091647e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0916477 expref: 12 pid: 18958 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843422.629144:0:18950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843422.629161:0:18950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:3307:x1875737795744768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843422.629174:0:18950:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843422.629181:0:18950:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab41533400/0xc6b8ac1b091647e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0916477 expref: 12 pid: 18958 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843422.629193:0:18950:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab41533400/0xc6b8ac1b091647e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0916477 expref: 12 pid: 18958 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843422.629206:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab41533400/0xc6b8ac1b091647e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0916477 expref: 12 pid: 18958 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843422.629228:0:18950:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b09164bd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843422.629236:0:18950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b09164bd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843422.629249:0:18950:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b09164bd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843422.629257:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b09164bd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843422.629264:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b09164bd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843422.629270:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b09164bd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843422.629276:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41532a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843422.629280:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b09164bd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843422.629287:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b09164bd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843422.629307:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b09164bd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843422.629316:0:18950:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843422.629379:0:18950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:345dfd18-3e4c-44c0-bf46-62bd805326d9+11:3307:x1875737795744768:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (463us total) trans 0 rc 0/0 00010000:00010000:1.0:1788843422.629537:0:19399:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b09164bd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843422.629556:0:19399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b09164bd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843422.629563:0:19399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b09164bd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843422.631290:0:18950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843422.631387:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:345dfd18-3e4c-44c0-bf46-62bd805326d9:3307:1875737795744768:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843422.917602:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843423.559914:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843413/real 1788843413] req@ffff8dab43783b80 x1875737795741824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843423 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843423.559956:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dab43783b80 x1875737795741824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843423 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843423.559968:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843413/real 1788843413] req@ffff8dab73a7ad80 x1875737795741696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843423 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843423.559980:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dab73a7ad80 x1875737795741696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843423 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788843423.560003:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab7772f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843423.560024:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788843423.560030:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795741824:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788843423.560036:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab51a7b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843423.560042:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788843423.560044:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795741696:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788843423.560159:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843423.560164:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788843423.560167:0:38:0:(import.c:65:import_set_state_nolock()) ffff8dab51a7b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843423.560193:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 538 00000100:00080000:1.0:1788843423.560200:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788843423.560208:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dab51a7b000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1788843423.560233:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab6e6bd880 x1875737795745024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843423.560247:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843423.560250:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788843423.560252:0:38:0:(import.c:65:import_set_state_nolock()) ffff8dab7772f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843423.560255:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 538 00000100:00080000:1.0:1788843423.560258:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788843423.560261:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dab7772f800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1788843423.560272:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab6e6bce00 x1875737795745152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788843423.560317:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:345dfd18-3e4c-44c0-bf46-62bd805326d9:3307:1875737795744896:0@lo:400:kworker.0 00000100:00100000:1.0:1788843423.560435:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843423.560504:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795745280:0@lo:400:kworker.0 00000100:00100000:1.0:1788843423.560544:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843423.560597:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795744896 00000100:00100000:1.0:1788843423.560606:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795744896 00000100:00100000:1.0:1788843423.560665:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788843423.560676:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+11:3307:x1875737795744896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843423.560735:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+11:3307:x1875737795744896:12345-0@lo:400:kworker.0 Request processed in 61us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843423.560744:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788843423.560794:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795745280 00000100:00100000:1.0:1788843423.560807:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795745280 00000100:00100000:1.0:1788843423.560843:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788843423.560850:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795745280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843423.560887:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795745280:12345-0@lo:400:kworker.0 Request processed in 38us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843423.560894:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788843423.561366:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dab6e6bc000 x1875737795745280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843423.561383:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795745280:0@lo:400:kworker.0 00000100:00100000:1.0:1788843423.561418:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:345dfd18-3e4c-44c0-bf46-62bd805326d9:3307:1875737795744896:0@lo:400:kworker.0 00000100:00100000:1.0:1788843423.561439:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795745024:0@lo:8:kworker.0 00000400:00000100:1.0:1788843423.561469:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875737795745024 offset 0 length 520: 4 00000100:00100000:1.0:1788843423.561484:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795745152:0@lo:8:kworker.0 00000400:00000100:1.0:1788843423.561499:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875737795745152 offset 0 length 520: 4 00010000:00010000:0.0:1788843423.940574:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788843424.267841:0:18962:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788843424.267851:0:18962:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab7c18f800 from 10 10000000:01000000:2.0:1788843424.267854:0:18962:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788843424.267918:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89c00/0xc6b8ac1b09164c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843424.267945:0:18962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89c00/0xc6b8ac1b09164c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843424.267960:0:18962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89c00/0xc6b8ac1b09164c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843424.267995:0:18962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795745408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788843424.268114:0:18962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843424.268186:0:18962:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab71b0f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788843424.268641:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795745408 00000100:00100000:1.0:1788843424.268654:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795745408 00000100:00100000:1.0:1788843424.268768:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788843424.268781:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+11:18962:x1875737795745408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843424.268799:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843424.268829:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b09164cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b09164c4 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843424.268860:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b09164cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b09164c4 expref: 12 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843424.268873:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b09164cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b09164c4 expref: 12 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843424.268895:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c5400, rc 0) 00000100:00100000:1.0:1788843424.271661:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:18962:x1875737795745408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2866us (3532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843424.271678:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788843424.273935:0:18962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795745408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843424.273979:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89c00/0xc6b8ac1b09164c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09164cb expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843424.273995:0:18962:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89c00/0xc6b8ac1b09164c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b09164cb expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843424.274209:0:18962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43783100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795745536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843424.274290:0:18962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843424.274371:0:18962:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab61d6a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788843424.274454:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795745536 00000100:00100000:2.0:1788843424.274463:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795745536 00000100:00100000:2.0:1788843424.274518:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788843424.274528:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:18962:x1875737795745536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843424.274839:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:18962:x1875737795745536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843424.274847:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788843424.274890:0:18962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43783100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795745536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843424.274922:0:18962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a78000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795745664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843424.274966:0:18962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843424.274988:0:18962:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab71b0f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788843424.274999:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795745664 00000100:00100000:2.0:1788843424.275002:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795745664 00000100:00100000:2.0:1788843424.275018:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788843424.275023:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:18962:x1875737795745664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843424.275415:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:18962:x1875737795745664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 389us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843424.275430:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788843424.275470:0:18962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a78000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795745664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788843424.277526:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788843424.282833:0:18962:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788843424.282885:0:18962:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788843424.282900:0:18962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89c00/0xc6b8ac1b09164c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09164cb expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843424.282937:0:18962:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89c00/0xc6b8ac1b09164c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09164cb expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843424.965268:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843425.994716:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788843426.309166:0:18997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788843427.018920:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843428.036777:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788843428.507070:0:19649:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788843428.507076:0:19649:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788843428.507215:0:19649:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dab441fa800 00000020:01000004:3.0:1788843428.507237:0:19649:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788843428.507251:0:19649:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788843428.507270:0:19649:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8dab7f714d28) 00000020:00000080:3.0:1788843428.507291:0:19649:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788843428.549719:0:19649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788843428.550044:0:19649:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788843428.550945:0:19649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788843428.551195:0:19649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788843428.560411:0:19649:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:3.0:1788843428.561711:0:19649:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:3.0:1788843428.561912:0:19649:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 403: rc = 0 00100000:10000000:3.0:1788843428.562063:0:19649:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 403: rc = 0 00100000:10000000:2.0:1788843428.566784:0:19649:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 539: rc = 0 00100000:10000000:2.0:1788843428.567147:0:19649:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 539: rc = 0 00100000:10000000:2.0:1788843428.568661:0:19649:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 539: rc = 0 00100000:10000000:0.0:1788843428.575504:0:19649:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 539: rc = 0 00100000:10000000:0.0:1788843428.575805:0:19649:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 539: rc = 0 00100000:10000000:0.0:1788843428.576319:0:19649:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 539: rc = 0 00000020:00000080:1.0:1788843428.585159:0:19649:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788843428.585173:0:19649:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788843428.585184:0:19649:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc6b8ac1b09164d9 00000020:01000004:1.0:1788843428.585192:0:19649:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788843428.585213:0:19649:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788843428.585217:0:19649:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788843428.585222:0:19649:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788843428.585229:0:19649:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788843428.585242:0:19649:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8dab6f874d28) 00000020:00000080:1.0:1788843428.585252:0:19649:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1788843428.588316:0:19649:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788843428.588591:0:19649:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788843428.588599:0:19649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788843428.592260:0:19649:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788843428.592281:0:19649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788843428.593325:0:19649:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788843428.593335:0:19649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788843428.595408:0:19649:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788843428.595756:0:19649:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788843428.595763:0:19649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788843428.598765:0:19649:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788843428.598782:0:19649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788843428.644298:0:19649:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788843428.644614:0:19649:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788843428.644620:0:19649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788843428.649030:0:19649:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788843428.649191:0:19649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788843428.650739:0:19649:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788843428.650750:0:19649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788843428.653242:0:19649:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788843428.653653:0:19649:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788843428.653660:0:19649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788843428.656850:0:19649:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788843428.656865:0:19649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00080000:3.0:1788843428.682443:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843428.682451:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788843428.682454:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843428.682457:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788843428.682500:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843428.682519:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:345dfd18-3e4c-44c0-bf46-62bd805326d9:3304:1875737795745792:0@lo:400:kworker.0 00000100:00100000:3.0:1788843428.682610:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843428.682672:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795745792 00000100:00100000:3.0:1788843428.682679:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795745792 00000100:00100000:3.0:1788843428.682736:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788843428.682745:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:3304:x1875737795745792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843428.682796:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:3304:x1875737795745792:12345-0@lo:400:kworker.0 Request processed in 51us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843428.682803:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788843428.682854:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:345dfd18-3e4c-44c0-bf46-62bd805326d9:3304:1875737795745792:0@lo:400:kworker.0 00000100:00100000:1.0:1788843428.683397:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795745920:0@lo:400:kworker.0 00000100:00100000:1.0:1788843428.683454:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843428.683560:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795745920 00000100:00100000:2.0:1788843428.683566:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795745920 00000100:00100000:2.0:1788843428.683604:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788843428.683611:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795745920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843428.683658:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795745920:12345-0@lo:400:kworker.0 Request processed in 48us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843428.683664:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788843428.683891:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dab43781180 x1875737795745920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843428.683904:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795745920:0@lo:400:kworker.0 00000100:00100000:3.0:1788843428.720599:0:19649:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843428.720830:0:19649:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788843428.720837:0:19649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788843428.741820:0:19649:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788843428.741834:0:19649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788843428.742254:0:19649:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788843428.742279:0:19649:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788843428.742284:0:19649:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788843428.761069:0:19649:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788843428.761117:0:19649:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.129@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788843428.761121:0:19649:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788843428.761123:0:19649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788843428.761124:0:19649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843428.761125:0:19649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843428.761126:0:19649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843428.761127:0:19649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843428.761128:0:19649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788843428.761130:0:19649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843428.761131:0:19649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788843428.761135:0:19649:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788843428.761137:0:19649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788843428.761138:0:19649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788843428.761139:0:19649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843428.761140:0:19649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843428.761141:0:19649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843428.761142:0:19649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843428.761143:0:19649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788843428.761144:0:19649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843428.761145:0:19649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788843428.761171:0:19649:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788843428.761191:0:19649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795746048:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788843428.761259:0:19649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843428.762856:0:19649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab440d59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843428.763828:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795746048 00000100:00100000:0.0:1788843428.763841:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795746048 00000100:00100000:0.0:1788843428.763937:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788843428.763948:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:19649:x1875737795746048:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788843428.763983:0:18960:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788843428.763987:0:18960:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788843428.763990:0:18960:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788843428.791592:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:19649:x1875737795746048:12345-0@lo:253:mount.lustre.0 Request processed in 27631us (30317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843428.791612:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788843428.791749:0:19649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795746048:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788843428.791769:0:19649:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788843428.791773:0:19649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788843428.791774:0:19649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788843428.791789:0:19649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843428.791809:0:19649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843428.791810:0:19649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843428.791812:0:19649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843428.791813:0:19649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788843428.791816:0:19649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843428.791817:0:19649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788843428.791842:0:19649:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dab441fa800 from lustre-OST0000 10000000:01000000:1.0:1788843428.791882:0:19649:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788843428.791885:0:19649:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788843428.791895:0:19649:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dab6f873370 local copy 00010000:00010000:1.0:1788843428.791909:0:19649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8daa42696800/0xc6b8ac1b09163cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09163d6 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843428.792910:0:19649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795746176:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843428.792983:0:19649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843428.793036:0:19649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab440d5240 going to sleep for 11 seconds 00000100:00100000:3.0:1788843428.793124:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795746176 00000100:00100000:3.0:1788843428.793139:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795746176 00000100:00100000:3.0:1788843428.793261:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788843428.793272:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:19649:x1875737795746176:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843428.793612:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:19649:x1875737795746176:12345-0@lo:501:mount.lustre.0 Request processed in 341us (628us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788843428.793622:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788843428.793679:0:19649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795746176:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788843428.793706:0:19649:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788843428.795898:0:19649:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788843428.795919:0:19649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8daa42696800/0xc6b8ac1b09163cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09163d6 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843428.795935:0:19649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8daa42696800/0xc6b8ac1b09163cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09163d6 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843428.795973:0:19649:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dab441fa800 10000000:01000000:1.0:1788843428.795979:0:19649:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788843428.795985:0:19649:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8dab6f873370 10000000:01000000:1.0:1788843428.795987:0:19649:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788843428.795991:0:19649:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8dab6f873370 from 1 10000000:01000000:1.0:1788843428.795994:0:19649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788843428.796060:0:19649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b09164e7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843428.796068:0:19649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b09164e7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843428.796082:0:19649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b09164e7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843428.796112:0:19649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795746304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788843428.796195:0:19649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843428.798728:0:19649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab440d5240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843428.808140:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795746304 00000100:00100000:2.0:1788843428.808156:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795746304 00000100:00100000:2.0:1788843428.808331:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788843428.808363:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+12:19649:x1875737795746304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843428.808381:0:18959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843428.808401:0:18959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7ff89800/0xc6b8ac1b09164ee lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b09164e7 expref: -99 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843428.808429:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff89800/0xc6b8ac1b09164ee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b09164e7 expref: 13 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843428.808440:0:18959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7ff89800/0xc6b8ac1b09164ee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b09164e7 expref: 13 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843428.808463:0:18959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89800, rc 0) 00000100:00100000:2.0:1788843428.808566:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+13:19649:x1875737795746304:12345-0@lo:101:mount.lustre.0 Request processed in 225us (12369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843428.808572:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788843428.808871:0:19649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795746304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843428.808891:0:19649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b09164e7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09164ee expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843428.808901:0:19649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b09164e7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b09164ee expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843428.808925:0:19649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788843428.808952:0:19649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b09164e7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09164ee expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843428.808961:0:19649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b09164e7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09164ee expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843428.808970:0:19649:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788843428.808975:0:19649:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788843428.808982:0:19649:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788843428.808991:0:19649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788843428.809033:0:19649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b09164f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843428.809042:0:19649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b09164f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843428.809049:0:19649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b09164f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843428.809068:0:19649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795746432:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788843428.809106:0:19649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843428.809136:0:19649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab440d5240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843428.809303:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795746432 00000100:00100000:2.0:1788843428.809308:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795746432 00000100:00100000:2.0:1788843428.809367:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788843428.809376:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+13:19649:x1875737795746432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843428.809386:0:18959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843428.809396:0:18959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7ff89e00/0xc6b8ac1b09164fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b09164f5 expref: -99 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843428.809412:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff89e00/0xc6b8ac1b09164fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b09164f5 expref: 14 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843428.809420:0:18959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7ff89e00/0xc6b8ac1b09164fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b09164f5 expref: 14 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843428.809428:0:18959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89e00, rc 0) 00000100:00100000:2.0:1788843428.809460:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+14:19649:x1875737795746432:12345-0@lo:101:mount.lustre.0 Request processed in 85us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843428.809466:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788843428.811111:0:19649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795746432:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843428.811136:0:19649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b09164f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09164fc expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843428.811149:0:19649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b09164f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b09164fc expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788843428.813800:0:19649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1788843428.814868:0:19649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843428.815126:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788843428.815193:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788843428.815241:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788843428.815288:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788843428.815321:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788843428.815383:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788843428.815432:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788843428.815467:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788843428.815512:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1788843428.815576:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1788843428.815612:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1788843428.815660:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1788843428.815738:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1788843428.815746:0:19649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1788843428.815832:0:19649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795746560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843428.815903:0:19649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843428.815942:0:19649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab440d5480 going to sleep for 11 seconds 00000100:00100000:2.0:1788843428.816229:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795746560 00000100:00100000:2.0:1788843428.816237:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795746560 00000100:00100000:2.0:1788843428.816279:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788843428.816289:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+14:19649:x1875737795746560:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843428.816705:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+14:19649:x1875737795746560:12345-0@lo:501:mount.lustre.0 Request processed in 416us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843428.816719:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788843428.821727:0:19649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795746560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843428.821792:0:19649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795746688:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843428.821868:0:19649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843428.821957:0:19649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab440d5480 going to sleep for 11 seconds 00000100:00100000:2.0:1788843428.827619:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795746688 00000100:00100000:2.0:1788843428.827635:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795746688 00000100:00100000:2.0:1788843428.827761:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788843428.827772:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+14:19649:x1875737795746688:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843428.829429:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+14:19649:x1875737795746688:12345-0@lo:503:mount.lustre.0 Request processed in 1653us (7554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843428.829442:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788843428.834878:0:19649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795746688:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788843428.839566:0:19649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788843428.839662:0:19649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795746816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843428.839752:0:19649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843428.839810:0:19649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab440d5480 going to sleep for 11 seconds 00000100:00100000:3.0:1788843428.840075:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795746816 00000100:00100000:3.0:1788843428.840082:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795746816 00000100:00100000:3.0:1788843428.840135:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788843428.840145:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c053050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+14:19649:x1875737795746816:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843428.840433:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c053050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+14:19649:x1875737795746816:12345-0@lo:502:mount.lustre.0 Request processed in 287us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843428.840442:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788843428.840672:0:19649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795746816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788843428.840905:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788843428.840966:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788843428.840999:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788843428.841047:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788843428.841081:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788843428.841114:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788843428.841289:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788843428.841329:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788843428.841403:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1788843428.841456:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1788843428.841494:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1788843428.841927:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1788843428.841977:0:19649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795746944:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843428.842043:0:19649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843428.842137:0:19649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab440d5480 going to sleep for 11 seconds 00000100:00100000:2.0:1788843428.842448:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795746944 00000100:00100000:2.0:1788843428.842457:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795746944 00000100:00100000:2.0:1788843428.842499:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788843428.842508:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c050850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+14:19649:x1875737795746944:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843428.842718:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c050850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+14:19649:x1875737795746944:12345-0@lo:502:mount.lustre.0 Request processed in 210us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843428.842727:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788843428.844724:0:19649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795746944:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788843428.844886:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1788843428.844902:0:19649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788843428.860612:0:19663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788843428.860625:0:19663:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788843428.860702:0:19663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843428.860711:0:19663:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788843428.860717:0:19663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788843428.860838:0:19663:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8dab75273370) 00000020:00000080:0.0:1788843428.860863:0:19663:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788843428.860871:0:19663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788843428.860953:0:19663:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dab441fa800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788843428.860961:0:19663:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788843428.860968:0:19663:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc6b8ac1b091650a 00010000:00010000:1.0:1788843428.866984:0:19663:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788843428.872540:0:19663:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934605 00080000:10000000:1.0:1788843428.875277:0:19663:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1788843428.886594:0:19663:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788843428.886609:0:19663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843428.886615:0:19663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843428.886617:0:19663:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788843428.886620:0:19663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788843428.886622:0:19663:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1788843428.886624:0:19663:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788843428.886626:0:19663:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788843428.892320:0:19663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788843428.892332:0:19663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843428.892334:0:19663:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788843428.892364:0:19663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843428.892370:0:19663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843428.892371:0:19663:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788843428.892375:0:19663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788843428.892376:0:19663:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788843428.892379:0:19663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843428.892381:0:19663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843428.892390:0:19663:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788843428.892393:0:19663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843428.892396:0:19663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843428.892397:0:19663:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788843428.892400:0:19663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788843428.892468:0:19663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843428.892472:0:19663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843428.892473:0:19663:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788843428.892477:0:19663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788843428.894272:0:19649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788843428.894311:0:19649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788843428.894328:0:19649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b09164f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09164fc expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843428.894366:0:19649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b09164f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09164fc expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843428.894382:0:19649:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab441fa800 from 1 10000000:01000000:2.0:1788843428.894386:0:19649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788843428.894426:0:19649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88600/0xc6b8ac1b0916511 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843428.894451:0:19649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88600/0xc6b8ac1b0916511 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843428.894462:0:19649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88600/0xc6b8ac1b0916511 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843428.894487:0:19649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795747072:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788843428.894560:0:19649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843428.894603:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795747072 00000100:00100000:2.0:1788843428.894610:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795747072 00000100:00100000:2.0:1788843428.897140:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788843428.897230:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+14:19649:x1875737795747072:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843428.897249:0:18959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843428.897269:0:18959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7ff89000/0xc6b8ac1b0916518 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0916511 expref: -99 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843428.897298:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff89000/0xc6b8ac1b0916518 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0916511 expref: 15 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843428.897309:0:18959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7ff89000/0xc6b8ac1b0916518 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0916511 expref: 15 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843428.897318:0:18959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89000, rc 0) 00000100:00100000:2.0:1788843428.897409:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+15:19649:x1875737795747072:12345-0@lo:101:mount.lustre.0 Request processed in 257us (2849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843428.897415:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788843428.897473:0:19649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab60061a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843428.897510:0:19649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795747072:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843428.897525:0:19649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88600/0xc6b8ac1b0916511 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916518 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843428.897534:0:19649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88600/0xc6b8ac1b0916511 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0916518 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788843428.902803:0:19649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:3.0:1788843428.904895:0:19649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843428.907857:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788843428.907933:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788843428.908098:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788843428.908221:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788843428.908265:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788843428.908311:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788843428.908486:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788843428.908526:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788843428.908620:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788843428.908696:0:19649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:3.0:1788843428.908811:0:19649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43781180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795747200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843428.908874:0:19649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843428.908970:0:19649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41aeba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843428.909082:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795747200 00000100:00100000:2.0:1788843428.909090:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795747200 00000100:00100000:2.0:1788843428.909231:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788843428.909242:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+15:19649:x1875737795747200:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843428.909670:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+15:19649:x1875737795747200:12345-0@lo:501:mount.lustre.0 Request processed in 429us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843428.909678:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788843428.909863:0:19649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43781180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795747200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843428.909904:0:19649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795747328:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843428.909947:0:19649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843428.909980:0:19649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab440d5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788843428.910093:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795747328 00000100:00100000:0.0:1788843428.910098:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795747328 00000100:00100000:0.0:1788843428.910135:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788843428.910142:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+15:19649:x1875737795747328:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843428.910300:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+15:19649:x1875737795747328:12345-0@lo:503:mount.lustre.0 Request processed in 158us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843428.910307:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788843428.910473:0:19649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795747328:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788843428.910955:0:19649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788843428.911023:0:19649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795747456:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843428.911067:0:19649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843428.911103:0:19649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab440d5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788843428.912881:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795747456 00000100:00100000:0.0:1788843428.912894:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795747456 00000100:00100000:0.0:1788843428.912954:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788843428.912963:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+15:19649:x1875737795747456:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843428.913392:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+15:19649:x1875737795747456:12345-0@lo:502:mount.lustre.0 Request processed in 429us (2323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843428.913400:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788843428.913525:0:19649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795747456:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788843428.913807:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788843428.913862:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788843428.913913:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788843428.913949:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788843428.913983:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788843428.914108:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788843428.914147:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788843428.914255:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:1.0:1788843428.914296:0:19649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795747584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843428.914388:0:19649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843428.914422:0:19649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab440d5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788843428.914693:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795747584 00000100:00100000:0.0:1788843428.914699:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795747584 00000100:00100000:0.0:1788843428.914740:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788843428.914748:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+15:19649:x1875737795747584:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843428.914921:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+15:19649:x1875737795747584:12345-0@lo:502:mount.lustre.0 Request processed in 173us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843428.914937:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788843428.915107:0:19649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795747584:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788843428.915270:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788843428.915281:0:19649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788843428.916690:0:19667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843428.916701:0:19667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843428.916703:0:19667:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788843428.916710:0:19667:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dab441fa800 00000020:00000080:1.0:1788843428.916712:0:19667:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788843428.916719:0:19667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843428.916721:0:19667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843428.916722:0:19667:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788843428.916725:0:19667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843428.916727:0:19667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843428.916728:0:19667:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788843428.916731:0:19667:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dab441fa800 00000020:00000080:1.0:1788843428.916734:0:19667:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788843428.916818:0:19667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843428.916823:0:19667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843428.916825:0:19667:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788843428.916827:0:19667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843428.916830:0:19667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843428.916832:0:19667:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788843428.916835:0:19667:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dab441fa800 00000020:00000080:1.0:1788843428.916837:0:19667:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788843428.928444:0:19667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843428.928457:0:19667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843428.928459:0:19667:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788843428.928464:0:19667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:2.0:1788843428.928722:0:19649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788843428.928749:0:19649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788843428.928773:0:19649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88600/0xc6b8ac1b0916511 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916518 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843428.928784:0:19649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88600/0xc6b8ac1b0916511 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916518 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843428.928824:0:19649:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788843428.928826:0:19649:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dab441fa800 10000000:01000000:2.0:1788843428.928829:0:19649:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dab441fa800 10000000:01000000:2.0:1788843428.928832:0:19649:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788843428.928838:0:19649:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dab441fa800 from 1 10000000:01000000:2.0:1788843428.928840:0:19649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788843428.928885:0:19649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88e00/0xc6b8ac1b091651f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843428.928894:0:19649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88e00/0xc6b8ac1b091651f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843428.928904:0:19649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88e00/0xc6b8ac1b091651f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843428.928926:0:19649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795747712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788843428.928985:0:19649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843428.930286:0:19649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab60061d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843428.930408:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795747712 00000100:00100000:1.0:1788843428.930423:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795747712 00000100:00100000:1.0:1788843428.930472:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788843428.930481:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+15:19649:x1875737795747712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843428.930495:0:18959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843428.930512:0:18959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab821c4a00/0xc6b8ac1b0916526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b091651f expref: -99 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843428.930539:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab821c4a00/0xc6b8ac1b0916526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b091651f expref: 16 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843428.930559:0:18959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab821c4a00/0xc6b8ac1b0916526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b091651f expref: 16 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843428.930567:0:18959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4a00, rc 0) 00000100:00100000:1.0:1788843428.930617:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:19649:x1875737795747712:12345-0@lo:101:mount.lustre.0 Request processed in 138us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843428.930624:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788843428.931121:0:19649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795747712:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843428.931137:0:19649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88e00/0xc6b8ac1b091651f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916526 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843428.931148:0:19649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88e00/0xc6b8ac1b091651f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0916526 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788843428.937337:0:19649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:2.0:1788843428.937896:0:19649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843428.942042:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788843428.942124:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788843428.942172:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788843428.942217:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788843428.942250:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788843428.942315:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788843428.942380:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788843428.942418:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788843428.942466:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788843428.942504:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788843428.942562:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788843428.942614:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788843428.942651:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788843428.942685:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788843428.942733:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788843428.942769:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788843428.942804:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788843428.942867:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788843428.942904:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788843428.942939:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788843428.942985:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788843428.943039:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788843428.943068:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788843428.943113:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788843428.943159:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:2.0:1788843428.943192:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:2.0:1788843428.943239:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:2.0:1788843428.943277:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:2.0:1788843428.943312:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:2.0:1788843428.943392:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:2.0:1788843428.943429:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:2.0:1788843428.943464:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:2.0:1788843428.943497:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:3.0:1788843428.957193:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:3.0:1788843428.957308:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:3.0:1788843428.957419:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:3.0:1788843428.957460:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:3.0:1788843428.957499:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:3.0:1788843428.957558:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:3.0:1788843428.957597:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:3.0:1788843428.957712:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:3.0:1788843428.957721:0:19649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:3.0:1788843428.957837:0:19649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795747840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843428.957905:0:19649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843428.957942:0:19649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41aeba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843428.959475:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795747840 00000100:00100000:2.0:1788843428.959487:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795747840 00000100:00100000:2.0:1788843428.959540:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788843428.959559:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:19649:x1875737795747840:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843428.959853:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:19649:x1875737795747840:12345-0@lo:501:mount.lustre.0 Request processed in 295us (1947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843428.959861:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788843428.960059:0:19649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795747840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843428.960109:0:19649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795747968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843428.960155:0:19649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843428.960195:0:19649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41aeba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788843428.960493:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795747968 00000100:00100000:0.0:1788843428.960499:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795747968 00000100:00100000:0.0:1788843428.960532:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788843428.960540:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:19649:x1875737795747968:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843428.960789:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:19649:x1875737795747968:12345-0@lo:503:mount.lustre.0 Request processed in 249us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843428.960796:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788843428.960843:0:19649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795747968:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788843428.962969:0:19649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788843428.963489:0:19649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795748096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843428.963575:0:19649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843428.963663:0:19649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab514a8600 going to sleep for 11 seconds 00000100:00100000:2.0:1788843428.969223:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795748096 00000100:00100000:2.0:1788843428.969256:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795748096 00000100:00100000:2.0:1788843428.969722:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788843428.969734:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:19649:x1875737795748096:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843428.970602:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:19649:x1875737795748096:12345-0@lo:502:mount.lustre.0 Request processed in 868us (7024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843428.970612:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788843428.970900:0:19649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795748096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788843428.971192:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788843428.971251:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788843428.971285:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788843428.971329:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788843428.971391:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788843428.971440:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788843428.971499:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788843428.971532:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788843428.971594:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788843428.971816:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788843428.971859:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788843428.971909:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788843428.971942:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788843428.971983:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788843428.972207:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788843428.972245:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788843428.972281:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788843428.972326:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788843428.975758:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788843428.975819:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788843428.975900:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788843428.975938:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788843428.976776:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788843428.976859:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788843428.976898:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:0.0:1788843428.976932:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:0.0:1788843428.976978:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:0.0:1788843428.977519:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:0.0:1788843428.977570:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:0.0:1788843428.977624:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:0.0:1788843428.978106:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:0.0:1788843428.978137:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:0.0:1788843428.978166:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:0.0:1788843428.978214:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:0.0:1788843428.978249:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:0.0:1788843428.978291:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:0.0:1788843428.978323:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:0.0:1788843428.980571:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:0.0:1788843428.980706:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:0.0:1788843428.980746:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:0.0:1788843428.980798:0:19649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795748224:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843428.980874:0:19649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843428.981650:0:19649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab514a8600 going to sleep for 11 seconds 00000100:00100000:2.0:1788843428.984117:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795748224 00000100:00100000:2.0:1788843428.984130:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795748224 00000100:00100000:2.0:1788843428.984216:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788843428.984227:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:19649:x1875737795748224:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843428.984537:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:19649:x1875737795748224:12345-0@lo:502:mount.lustre.0 Request processed in 311us (3661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843428.984554:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788843428.984667:0:19649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795748224:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788843428.984787:0:19649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:0.0:1788843428.984803:0:19649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788843428.988938:0:19672:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788843428.988955:0:19672:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8dab75274d28) 00000020:00000080:0.0:1788843428.988978:0:19672:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788843428.989075:0:19672:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dab441fa800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788843428.989080:0:19672:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dab441fa800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788843428.989083:0:19672:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab441fa800 3 00010000:00080000:0.0:1788843428.989120:0:19672:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dab6fd98800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.129@tcp at head 00010000:00010000:0.0:1788843428.994693:0:19672:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788843428.994982:0:19672:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788843428.995031:0:19672:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788843428.995043:0:19672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc6b8ac1b0916534 00000100:00080000:0.0:1788843428.995052:0:19672:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788843428.995058:0:19672:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dab6fd98800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1788843428.995091:0:19672:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab7cd42a00 x1875737795748352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788843428.995120:0:19672:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788843428.995260:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875737795748352:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788843428.995333:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788843428.995679:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843428.995685:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788843428.995688:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843428.995691:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788843428.995739:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843428.995749:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795748480:0@lo:400:kworker.0 00000100:00100000:3.0:1788843428.995780:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843428.995887:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795748352 00000100:00100000:0.0:1788843428.995894:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795748352 00000100:00100000:0.0:1788843428.995915:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795748480 00000100:00100000:0.0:1788843428.995917:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795748480 00000100:00100000:0.0:1788843428.995939:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843428.995947:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795748480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843428.996071:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795748480:12345-0@lo:400:kworker.0 Request processed in 123us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843428.996078:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843428.996095:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843428.996110:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1875737795748352:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788843428.996131:0:18966:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:0.0:1788843428.996173:0:18966:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc6b8ac1b091653b 00000004:00100000:0.0:1788843428.996188:0:18966:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788843428.996216:0:18966:0:(import.c:65:import_set_state_nolock()) ffff8dab6fd9b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843428.996252:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875737795748352:12345-0@lo:38:llog_process_th.0 Request processed in 140us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843428.996258:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788843428.996292:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dab43780700 x1875737795748480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843428.996307:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795748480:0@lo:400:kworker.0 00000040:00080000:0.0:1788843428.996458:0:19672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00010000:00080000:1.0:1788843428.996640:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dab7cd42a00 x1875737795748352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843428.996650:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788843428.996655:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788843428.996662:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788843428.996667:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788843428.996669:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab6fd98800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788843428.996675:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875737795748352:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788843428.996705:0:19649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788843428.996730:0:19649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788843428.996752:0:19649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88e00/0xc6b8ac1b091651f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916526 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843428.996764:0:19649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88e00/0xc6b8ac1b091651f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916526 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788843428.996812:0:19649:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788843428.996814:0:19649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788843428.996815:0:19649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843428.996816:0:19649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843428.996818:0:19649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843428.996819:0:19649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843428.996820:0:19649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788843428.996823:0:19649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843428.996824:0:19649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788843428.996828:0:19649:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788843428.996830:0:19649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788843428.996832:0:19649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788843428.996832:0:19649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843428.996834:0:19649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843428.996834:0:19649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843428.996835:0:19649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843428.996836:0:19649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788843428.996837:0:19649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843428.996838:0:19649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788843428.996853:0:19649:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788843428.996865:0:19649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795748608:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788843428.996903:0:19649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843428.996931:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795748608 00000100:00100000:1.0:1788843428.996935:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795748608 00000100:00100000:1.0:1788843428.996964:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788843428.996971:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:19649:x1875737795748608:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788843428.997010:0:18959:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788843428.997023:0:18959:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788843428.999293:0:19649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab440d5240 going to sleep for 11 seconds 20000000:01000000:0.0:1788843429.033199:0:18959:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788843429.033223:0:18959:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788843429.033289:0:18981:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788843429.033294:0:18981:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788843429.033315:0:18981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dab41533400/0xc6b8ac1b0916542 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843429.033334:0:18981:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab7ff88400/0xc6b8ac1b09164af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b09164a8 expref: 16 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843429.033373:0:18981:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dab41533400/0xc6b8ac1b0916542 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843429.033411:0:18981:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab7ff88400/0xc6b8ac1b09164af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b09164a8 expref: 16 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843429.033441:0:18981:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab7ff88400/0xc6b8ac1b09164af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b09164a8 expref: 16 pid: 18958 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843429.033456:0:18981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43780700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18981:1875737795748736:0@lo:104: 00000100:00100000:3.0:1788843429.033520:0:18981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843429.033570:0:18981:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46b770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843429.033850:0:18949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795748736 00000100:00100000:0.0:1788843429.033857:0:18949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795748736 00000100:00100000:0.0:1788843429.033903:0:18949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843429.033912:0:18949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:345dfd18-3e4c-44c0-bf46-62bd805326d9+3:18981:x1875737795748736:12345-0@lo:104: 00010000:00010000:0.0:1788843429.033924:0:18949:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8daa42696400/0xc6b8ac1b09164a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b09164af expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843429.034000:0:18949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788843429.034007:0:18949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:345dfd18-3e4c-44c0-bf46-62bd805326d9+3:18981:x1875737795748736:12345-0@lo:104: Request processed in 97us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843429.034014:0:18949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788843429.034067:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843429.034076:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8daa42696400/0xc6b8ac1b09164a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b09164af expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843429.034085:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42696400 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:1.0:1788843429.034090:0:18954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8daa42696400/0xc6b8ac1b09164a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b09164af expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843429.034099:0:18954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8daa42696400/0xc6b8ac1b09164a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b09164af expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843429.034107:0:18954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8daa42696400/0xc6b8ac1b09164a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b09164af expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843429.034113:0:18954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788843429.034150:0:18954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8daa42696400/0xc6b8ac1b09164a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b09164af expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843429.034158:0:18954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843429.034178:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8daa42696400/0xc6b8ac1b09164a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b09164af expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843429.034185:0:18954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8daa42696400/0xc6b8ac1b09164a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b09164af expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843429.034201:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843429.034203:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843429.034205:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843429.034225:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788843429.034238:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:345dfd18-3e4c-44c0-bf46-62bd805326d9:3305:1875737795748864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843429.034273:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843429.034313:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795748864 00000100:00100000:3.0:1788843429.034318:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795748864 00010000:00010000:3.0:1788843429.034335:0:18951:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab7ff88400/0xc6b8ac1b09164af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b09164a8 expref: 17 pid: 18958 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843429.034384:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843429.034392:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:345dfd18-3e4c-44c0-bf46-62bd805326d9+17:3305:x1875737795748864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843429.034402:0:18951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788843429.034403:0:18981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43780700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18981:1875737795748736:0@lo:104: 00010000:00010000:3.0:1788843429.034410:0:18951:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab7ff88400/0xc6b8ac1b09164af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b09164a8 expref: 17 pid: 18958 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843429.034422:0:18951:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab7ff88400/0xc6b8ac1b09164af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b09164a8 expref: 17 pid: 18958 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843429.034929:0:18981:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dab41533400/0xc6b8ac1b0916542 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843429.042267:0:18951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7ff88400/0xc6b8ac1b09164af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b09164a8 expref: 17 pid: 18958 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843429.042297:0:18951:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dab41533400/0xc6b8ac1b0916542 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843429.042306:0:18951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab41533400/0xc6b8ac1b0916542 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788843429.042363:0:18951:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009068949s 00010000:00010000:3.0:1788843429.042369:0:18951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab41533400/0xc6b8ac1b0916542 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843429.042377:0:18951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab41533400/0xc6b8ac1b0916542 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843429.042384:0:18951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dab41533400/0xc6b8ac1b0916542 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843429.042391:0:18951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dab41533400/0xc6b8ac1b0916542 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843429.042398:0:18951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41533400 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843429.042402:0:18951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dab41533400/0xc6b8ac1b0916542 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843429.042411:0:18951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dab41533400/0xc6b8ac1b0916542 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843429.042432:0:18951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dab41533400/0xc6b8ac1b0916542 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843429.042443:0:18951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843429.042503:0:18981:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dab41533400/0xc6b8ac1b0916542 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843429.042526:0:18981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dab41533400/0xc6b8ac1b0916542 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843429.042528:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:3305:x1875737795748864:12345-0@lo:103:ldlm_bl.0 Request processed in 8133us (8250us total) trans 0 rc 0/0 00010000:00010000:0.0:1788843429.042550:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab41533400/0xc6b8ac1b0916542 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843429.043215:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843429.043290:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:345dfd18-3e4c-44c0-bf46-62bd805326d9:3305:1875737795748864:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843429.060484:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843429.074277:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+15:19649:x1875737795748608:12345-0@lo:253:mount.lustre.0 Request processed in 77297us (77364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843429.074294:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788843429.074423:0:19649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:19649:1875737795748608:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788843429.074438:0:19649:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788843429.074442:0:19649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788843429.074443:0:19649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788843429.074445:0:19649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843429.074446:0:19649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843429.074447:0:19649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843429.074449:0:19649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843429.074450:0:19649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788843429.074452:0:19649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843429.074454:0:19649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788843429.074467:0:19649:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788843429.074884:0:19649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788843429.075115:0:19649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788843429.075262:0:19649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788843429.075449:0:19649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788843429.075609:0:19649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788843429.075787:0:19649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788843429.086488:0:19649:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788843429.161279:0:19649:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788843429.161287:0:19649:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788843429.161318:0:19649:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788843429.161399:0:19649:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788843429.161413:0:19649:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788843429.161440:0:19649:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788843430.086106:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788843430.789833:0:18962:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788843430.789840:0:18962:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dab7c18f800 from 10 10000000:01000000:1.0:1788843430.789844:0:18962:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788843430.789886:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0916549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.789898:0:18962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0916549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.789908:0:18962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0916549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.789946:0:18962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795748992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788843430.790007:0:18962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843430.790055:0:18962:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab603b7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788843430.790093:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795748992 00000100:00100000:2.0:1788843430.790101:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795748992 00000100:00100000:2.0:1788843430.790157:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788843430.790166:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+15:18962:x1875737795748992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843430.790187:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843430.790207:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7ff89400/0xc6b8ac1b0916550 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0916549 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843430.790233:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff89400/0xc6b8ac1b0916550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0916549 expref: 16 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843430.790242:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7ff89400/0xc6b8ac1b0916550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0916549 expref: 16 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843430.790250:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89400, rc 0) 00000100:00100000:2.0:1788843430.790303:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:18962:x1875737795748992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843430.790309:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788843430.790436:0:18962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795748992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843430.790451:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0916549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916550 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.790459:0:18962:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0916549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0916550 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843430.790509:0:18962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795749120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788843430.790550:0:18962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.790579:0:18962:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab514a8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843430.790684:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795749120 00000100:00100000:2.0:1788843430.790689:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795749120 00000100:00100000:2.0:1788843430.790721:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788843430.790728:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:18962:x1875737795749120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788843430.790741:0:18959:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788843430.790758:0:18959:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788843430.790761:0:18959:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788843430.790833:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:18962:x1875737795749120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843430.790840:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788843430.790903:0:18962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795749120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788843430.790958:0:18962:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788843430.790965:0:18962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0916549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916550 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.790983:0:18962:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0916549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916550 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843431.110811:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843432.134571:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843433.156478:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843434.215802:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788843434.308468:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843434.308482:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788843434.308485:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843434.308489:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788843434.308551:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795749504:0@lo:400:kworker.0 00000100:00100000:1.0:1788843434.308574:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:345dfd18-3e4c-44c0-bf46-62bd805326d9:3305:1875737795749248:0@lo:400:kworker.0 00000100:00100000:0.0:1788843434.308594:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795749376:0@lo:400:kworker.0 00000100:00100000:1.0:1788843434.310619:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843434.310697:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795749248 00000100:00100000:1.0:1788843434.310706:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795749248 00000100:00100000:1.0:1788843434.310750:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788843434.310759:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:3305:x1875737795749248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843434.310813:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:3305:x1875737795749248:12345-0@lo:400:kworker.0 Request processed in 55us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843434.310820:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788843434.310864:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:345dfd18-3e4c-44c0-bf46-62bd805326d9:3305:1875737795749248:0@lo:400:kworker.0 00000100:00100000:3.0:1788843434.312222:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843434.312696:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795749504 00000100:00100000:1.0:1788843434.312706:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795749504 00000100:00080000:3.0:1788843434.312749:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843434.312765:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788843434.312776:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795749504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843434.312854:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795749504:12345-0@lo:400:kworker.0 Request processed in 80us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843434.312861:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788843434.312898:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab43783b80 x1875737795749504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843434.312913:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795749504:0@lo:400:kworker.0 00000100:00100000:0.0:1788843434.313626:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843434.314333:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795749376 00000100:00100000:3.0:1788843434.314365:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795749376 00000100:00100000:3.0:1788843434.314401:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843434.314409:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795749376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843434.314470:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795749376:12345-0@lo:400:kworker.0 Request processed in 61us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843434.314477:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788843434.314975:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab43783100 x1875737795749376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843434.314989:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795749376:0@lo:400:kworker.0 00010000:00010000:2.0:1788843435.268738:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788843435.898798:0:20018:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788843436.292609:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843436.548996:0:18997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788843437.317777:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843438.212533:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843423/real 1788843423] req@ffff8dab6e6bd880 x1875737795745024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843438 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843438.212580:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dab6e6bd880 x1875737795745024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843438 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843438.212593:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843423/real 1788843423] req@ffff8dab6e6bce00 x1875737795745152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843438 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843438.212605:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dab6e6bce00 x1875737795745152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843438 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788843438.212631:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab51a7b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788843438.212667:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788843438.212671:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795745024:0@lo:8:kworker.0 00000100:00080000:0.0:1788843438.212702:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab7772f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788843438.212709:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788843438.212713:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795745152:0@lo:8:kworker.0 00000100:00100000:0.0:1788843438.212988:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:345dfd18-3e4c-44c0-bf46-62bd805326d9:3304:1875737795749632:0@lo:400:kworker.0 00000100:00100000:0.0:1788843438.213088:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843438.213499:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795749632 00000100:00100000:3.0:1788843438.213510:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795749632 00000100:00100000:3.0:1788843438.213576:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788843438.213589:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:3304:x1875737795749632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843438.213666:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:3304:x1875737795749632:12345-0@lo:400:kworker.0 Request processed in 79us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843438.213674:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788843438.213732:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:345dfd18-3e4c-44c0-bf46-62bd805326d9:3304:1875737795749632:0@lo:400:kworker.0 00000100:00080000:1.0:1788843438.213995:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843438.214000:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788843438.214005:0:38:0:(import.c:65:import_set_state_nolock()) ffff8dab51a7b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843438.214019:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 547 00000100:00080000:1.0:1788843438.214024:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788843438.214030:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dab51a7b000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1788843438.217962:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab73a78000 x1875737795749760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843438.218008:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843438.218013:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788843438.218036:0:38:0:(import.c:65:import_set_state_nolock()) ffff8dab7772f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788843438.218051:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 547 00000100:00080000:2.0:1788843438.218058:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788843438.218067:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dab7772f800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1788843438.218091:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab73a7b100 x1875737795749888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788843438.218447:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795749760:0@lo:8:kworker.0 00000100:00100000:1.0:1788843438.218552:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843438.218607:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795749888:0@lo:8:kworker.0 00000100:00100000:1.0:1788843438.218631:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843438.218687:0:19650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795749760 00000100:00100000:1.0:1788843438.218696:0:19650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795749760 00000100:00100000:1.0:1788843438.218730:0:19650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795749888 00000100:00100000:1.0:1788843438.218733:0:19650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795749888 00000100:00100000:1.0:1788843438.218747:0:19650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788843438.218755:0:19650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875737795749760:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788843438.218794:0:19650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:1.0:1788843438.218841:0:19650:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b8ac1b0916557 00002000:00100000:1.0:1788843438.218860:0:19650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dab48815800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113970 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788843438.218865:0:19650:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788843438.218868:0:19650:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788843438.219592:0:19650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788843438.219632:0:19650:0:(import.c:65:import_set_state_nolock()) ffff8dab48816800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843438.219729:0:19650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875737795749760:12345-0@lo:8:kworker.0 Request processed in 971us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843438.219740:0:19650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788843438.219771:0:19650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843438.219777:0:19650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875737795749888:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788843438.219795:0:19650:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788843438.220011:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843438.220031:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795750144:0@lo:400:kworker.0 00000100:00100000:3.0:1788843438.220094:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843438.220141:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795750016:0@lo:400:kworker.0 00000100:00100000:3.0:1788843438.220166:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843438.220210:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795750144 00000100:00100000:3.0:1788843438.220216:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795750144 00000100:00100000:3.0:1788843438.220267:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795750016 00000100:00100000:3.0:1788843438.220270:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795750016 00000100:00100000:3.0:1788843438.220285:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843438.220292:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795750144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843438.220365:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795750144:12345-0@lo:400:kworker.0 Request processed in 49us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843438.220372:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843438.220387:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788843438.220393:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795750016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843438.220424:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795750016:12345-0@lo:400:kworker.0 Request processed in 32us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843438.220431:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788843438.220448:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788843438.220497:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab73a79c00 x1875737795750016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843438.220514:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795750016:0@lo:400:kworker.0 00010000:00080000:3.0:1788843438.220552:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab73a7b800 x1875737795750144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843438.220577:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795750144:0@lo:400:kworker.0 00010000:00080000:0.0:1788843438.232857:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab73a78000 x1875737795749760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788843458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843438.232877:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788843438.232893:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788843438.232905:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788843438.232914:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788843438.232918:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab51a7b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788843438.233013:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788843438.233022:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795749760:0@lo:8:kworker.0 00000004:00080000:3.0:1788843438.236249:0:18987:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788843438.236969:0:18987:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 562487625476ns, next at 0ns, rc = 0 00000004:00080000:2.0:1788843438.245444:0:18988:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x22:0x0] 00000100:00100000:2.0:1788843438.245496:0:18988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a78000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18988:1875737795750400:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788843438.245852:0:18988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843438.245904:0:18988:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab77787cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843438.245948:0:19651:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788843438.245957:0:19651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788843438.246090:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843438.246107:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795750272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843438.246142:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843438.246202:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795750400 00000100:00100000:2.0:1788843438.246212:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795750400 00000100:00100000:2.0:1788843438.246512:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843438.246526:0:20132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18988:x1875737795750400:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1788843438.247167:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843438.247693:0:19653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795750272 00000100:00100000:3.0:1788843438.247703:0:19653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795750272 00000100:00100000:3.0:1788843438.247754:0:19653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843438.247764:0:19653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875737795750272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843438.247805:0:19653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788843438.247899:0:19653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875737795750272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (1755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843438.247908:0:19653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788843438.249148:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab73a7b480 x1875737795750272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843438.249180:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795750272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843438.261179:0:19650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875737795749888:12345-0@lo:8:kworker.0 Request processed in 41389us (42535us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788843438.261208:0:19650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788843438.263382:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab7772f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788843438.263398:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788843438.263404:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795749888:0@lo:8:kworker.0 00002000:00080000:3.0:1788843438.278586:0:20132:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788843438.278603:0:20132:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1788843438.278609:0:20132:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:65) 00002000:00010000:3.0:1788843438.313785:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788843438.313802:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f32b4167/0xc6b8ac1b091655e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.313826:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1788843438.313832:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843438.313840:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f32b4167/0xc6b8ac1b091655e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.313865:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f32b4167/0xc6b8ac1b091655e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.313891:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f32b4167/0xc6b8ac1b091655e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.313900:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f32b4167/0xc6b8ac1b091655e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.313937:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788843438.313963:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843438.313972:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f32b4167/0xc6b8ac1b091655e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.313981:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41532200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843438.313986:0:18954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f32b4167/0xc6b8ac1b091655e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.313997:0:18954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f32b4167/0xc6b8ac1b091655e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.314020:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f32b4167/0xc6b8ac1b091655e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.314029:0:18954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f32b4167/0xc6b8ac1b091655e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.314052:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843438.314061:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843438.314063:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788843438.314731:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788843438.314740:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a01ca13/0xc6b8ac1b0916565 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.314752:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1788843438.314756:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843438.314762:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a01ca13/0xc6b8ac1b0916565 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.314773:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a01ca13/0xc6b8ac1b0916565 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.314783:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a01ca13/0xc6b8ac1b0916565 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.314792:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a01ca13/0xc6b8ac1b0916565 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.314812:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788843438.314823:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843438.314828:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a01ca13/0xc6b8ac1b0916565 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.314835:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41532a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843438.314839:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a01ca13/0xc6b8ac1b0916565 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.314858:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a01ca13/0xc6b8ac1b0916565 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.314870:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a01ca13/0xc6b8ac1b0916565 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.314878:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a01ca13/0xc6b8ac1b0916565 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.314893:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843438.314895:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843438.314897:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788843438.315336:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788843438.315386:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2cbeeec/0xc6b8ac1b091656c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.315397:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=562s v=(0 0) 00010000:00010000:3.0:1788843438.315401:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843438.315406:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2cbeeec/0xc6b8ac1b091656c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.315415:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2cbeeec/0xc6b8ac1b091656c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.315425:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2cbeeec/0xc6b8ac1b091656c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.315439:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2cbeeec/0xc6b8ac1b091656c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.315456:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788843438.315468:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843438.315473:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2cbeeec/0xc6b8ac1b091656c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788843438.316612:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.316625:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038ed9fd8/0xc6b8ac1b0916573 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.316642:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.316647:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.316653:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038ed9fd8/0xc6b8ac1b0916573 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.316668:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038ed9fd8/0xc6b8ac1b0916573 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.316679:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038ed9fd8/0xc6b8ac1b0916573 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.316688:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038ed9fd8/0xc6b8ac1b0916573 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.316713:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788843438.317127:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.317133:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b005eb9/0xc6b8ac1b091657a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.317143:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.317154:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.317159:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b005eb9/0xc6b8ac1b091657a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.317169:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b005eb9/0xc6b8ac1b091657a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.317178:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b005eb9/0xc6b8ac1b091657a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.317186:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b005eb9/0xc6b8ac1b091657a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.317195:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788843438.317630:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.317636:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0916581 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.317646:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.317649:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.317653:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0916581 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.317662:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0916581 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.317671:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0916581 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.317684:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0916581 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.317693:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788843438.318129:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.318135:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000776d1d16/0xc6b8ac1b0916588 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.318143:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.318146:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.318150:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000776d1d16/0xc6b8ac1b0916588 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.318160:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000776d1d16/0xc6b8ac1b0916588 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.318168:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000776d1d16/0xc6b8ac1b0916588 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.318175:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000776d1d16/0xc6b8ac1b0916588 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.318184:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788843438.318670:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.318677:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000babd2ba4/0xc6b8ac1b091658f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.318693:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.318697:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.318701:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000babd2ba4/0xc6b8ac1b091658f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.318712:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000babd2ba4/0xc6b8ac1b091658f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.318721:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000babd2ba4/0xc6b8ac1b091658f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.318729:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000babd2ba4/0xc6b8ac1b091658f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.318738:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788843438.319136:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.319141:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916596 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.319149:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.319152:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.319156:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916596 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.319164:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916596 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.319181:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916596 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.319187:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916596 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.319195:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1788843438.319736:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788843438.319944:0:20134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788843438.319955:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038ed9fd8/0xc6b8ac1b0916573 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.319982:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4e00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843438.319988:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038ed9fd8/0xc6b8ac1b0916573 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.319999:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038ed9fd8/0xc6b8ac1b0916573 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320026:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038ed9fd8/0xc6b8ac1b0916573 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320035:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038ed9fd8/0xc6b8ac1b0916573 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320063:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788843438.320067:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0916581 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320074:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843438.320077:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0916581 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320085:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0916581 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320094:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0916581 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320108:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0916581 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320123:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788843438.320127:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000776d1d16/0xc6b8ac1b0916588 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320134:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fceea00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843438.320137:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000776d1d16/0xc6b8ac1b0916588 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320145:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000776d1d16/0xc6b8ac1b0916588 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320154:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000776d1d16/0xc6b8ac1b0916588 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320160:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000776d1d16/0xc6b8ac1b0916588 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320170:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843438.320174:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000babd2ba4/0xc6b8ac1b091658f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320180:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcee400 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843438.320187:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000babd2ba4/0xc6b8ac1b091658f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320195:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000babd2ba4/0xc6b8ac1b091658f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320204:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000babd2ba4/0xc6b8ac1b091658f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320211:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000babd2ba4/0xc6b8ac1b091658f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320222:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843438.320226:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916596 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320232:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcee200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843438.320236:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916596 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320243:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916596 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320251:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916596 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320258:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916596 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.320276:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843438.320277:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843438.320280:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.322588:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.322595:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.322598:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843438.322704:0:20134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b005eb9/0xc6b8ac1b091657a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.322723:0:20134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5e00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843438.322729:0:20134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b005eb9/0xc6b8ac1b091657a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.322742:0:20134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b005eb9/0xc6b8ac1b091657a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.322770:0:20134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b005eb9/0xc6b8ac1b091657a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.322777:0:20134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b005eb9/0xc6b8ac1b091657a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.322809:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843438.322811:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843438.322812:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843438.332407:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41533400 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843438.332416:0:18954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2cbeeec/0xc6b8ac1b091656c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.332433:0:18954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2cbeeec/0xc6b8ac1b091656c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.332463:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2cbeeec/0xc6b8ac1b091656c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.332471:0:18954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2cbeeec/0xc6b8ac1b091656c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.335749:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843438.335759:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843438.335763:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843438.337135:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.337151:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cea536fa/0xc6b8ac1b091659d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.337175:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.337180:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.337187:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cea536fa/0xc6b8ac1b091659d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.337204:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cea536fa/0xc6b8ac1b091659d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.337216:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cea536fa/0xc6b8ac1b091659d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.337223:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cea536fa/0xc6b8ac1b091659d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.337270:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843438.337285:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843438.337293:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cea536fa/0xc6b8ac1b091659d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.337302:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcefe00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843438.337307:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cea536fa/0xc6b8ac1b091659d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.337317:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cea536fa/0xc6b8ac1b091659d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.337371:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cea536fa/0xc6b8ac1b091659d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.337381:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cea536fa/0xc6b8ac1b091659d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.337401:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843438.337403:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843438.337405:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843438.337943:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.337950:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061712246/0xc6b8ac1b09165a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.337961:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.337970:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.337975:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061712246/0xc6b8ac1b09165a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.337986:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061712246/0xc6b8ac1b09165a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.337995:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061712246/0xc6b8ac1b09165a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.338002:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061712246/0xc6b8ac1b09165a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.338023:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788843438.338465:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.338472:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b37969a/0xc6b8ac1b09165ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.338496:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.338500:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.338504:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b37969a/0xc6b8ac1b09165ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.338513:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b37969a/0xc6b8ac1b09165ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.338521:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b37969a/0xc6b8ac1b09165ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.338535:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b37969a/0xc6b8ac1b09165ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.338550:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788843438.339421:0:20135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843438.339433:0:20135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061712246/0xc6b8ac1b09165a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.339446:0:20135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fceec00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843438.339452:0:20135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061712246/0xc6b8ac1b09165a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.339463:0:20135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061712246/0xc6b8ac1b09165a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.339985:0:20134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843438.340002:0:20134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b37969a/0xc6b8ac1b09165ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.340011:0:20134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcef200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843438.340014:0:20134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b37969a/0xc6b8ac1b09165ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.340023:0:20134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b37969a/0xc6b8ac1b09165ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.340041:0:20134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b37969a/0xc6b8ac1b09165ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.340048:0:20134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b37969a/0xc6b8ac1b09165ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.340073:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843438.340075:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843438.340077:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843438.344695:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788843438.346005:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788843438.346021:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050853035/0xc6b8ac1b09165b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.346042:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1788843438.346048:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843438.346055:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050853035/0xc6b8ac1b09165b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.346085:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050853035/0xc6b8ac1b09165b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.346098:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050853035/0xc6b8ac1b09165b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.346106:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050853035/0xc6b8ac1b09165b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.346133:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788843438.347064:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788843438.347075:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079de8e10/0xc6b8ac1b09165b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.347090:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1788843438.347094:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843438.347099:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079de8e10/0xc6b8ac1b09165b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.347111:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079de8e10/0xc6b8ac1b09165b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.347120:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079de8e10/0xc6b8ac1b09165b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.347139:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079de8e10/0xc6b8ac1b09165b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.347162:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788843438.347689:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843438.347701:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050853035/0xc6b8ac1b09165b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.347713:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843438.347726:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050853035/0xc6b8ac1b09165b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.347736:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050853035/0xc6b8ac1b09165b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.347759:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050853035/0xc6b8ac1b09165b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.347766:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050853035/0xc6b8ac1b09165b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.347792:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843438.347796:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079de8e10/0xc6b8ac1b09165b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.347802:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88400 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843438.347806:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079de8e10/0xc6b8ac1b09165b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.347814:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079de8e10/0xc6b8ac1b09165b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.347825:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079de8e10/0xc6b8ac1b09165b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.347832:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079de8e10/0xc6b8ac1b09165b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.347851:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.347853:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.347855:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788843438.348154:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788843438.348160:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5a53b49/0xc6b8ac1b09165c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.348170:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1788843438.348174:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843438.348179:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5a53b49/0xc6b8ac1b09165c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.348189:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5a53b49/0xc6b8ac1b09165c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.348198:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5a53b49/0xc6b8ac1b09165c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.348206:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5a53b49/0xc6b8ac1b09165c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.348434:0:20135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061712246/0xc6b8ac1b09165a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.348444:0:20135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061712246/0xc6b8ac1b09165a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.348663:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788843438.350546:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788843438.350559:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f1fe06a/0xc6b8ac1b09165c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.350658:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1788843438.350663:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843438.350670:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f1fe06a/0xc6b8ac1b09165c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.350686:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f1fe06a/0xc6b8ac1b09165c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.350699:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f1fe06a/0xc6b8ac1b09165c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843438.350708:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f1fe06a/0xc6b8ac1b09165c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.355457:0:20135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843438.355879:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843438.355897:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f1fe06a/0xc6b8ac1b09165c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.355916:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88c00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843438.355922:0:18954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f1fe06a/0xc6b8ac1b09165c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.355936:0:18954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f1fe06a/0xc6b8ac1b09165c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.355963:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f1fe06a/0xc6b8ac1b09165c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.356005:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.356007:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.356009:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843438.356599:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788843438.356611:0:20132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f1fe06a/0xc6b8ac1b09165c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.357611:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843438.358162:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843438.358333:0:20135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5a53b49/0xc6b8ac1b09165c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.358389:0:20135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843438.358396:0:20135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5a53b49/0xc6b8ac1b09165c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.358408:0:20135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5a53b49/0xc6b8ac1b09165c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.358434:0:20135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5a53b49/0xc6b8ac1b09165c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.358442:0:20135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5a53b49/0xc6b8ac1b09165c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.363492:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843438.363500:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843438.363503:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843438.367570:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.367585:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061712246/0xc6b8ac1b09165ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.367605:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.367610:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.367617:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061712246/0xc6b8ac1b09165ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.367631:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061712246/0xc6b8ac1b09165ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.367651:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061712246/0xc6b8ac1b09165ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.367659:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061712246/0xc6b8ac1b09165ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.367686:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788843438.368133:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843438.368148:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061712246/0xc6b8ac1b09165ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.368179:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fceec00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843438.368185:0:18954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061712246/0xc6b8ac1b09165ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.368197:0:18954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061712246/0xc6b8ac1b09165ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.368266:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061712246/0xc6b8ac1b09165ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.368287:0:18954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061712246/0xc6b8ac1b09165ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.368437:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843438.368500:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843438.368503:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843438.372324:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.372338:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cea536fa/0xc6b8ac1b09165d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.372386:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.372391:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.372397:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cea536fa/0xc6b8ac1b09165d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.372412:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cea536fa/0xc6b8ac1b09165d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.372424:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cea536fa/0xc6b8ac1b09165d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.372432:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cea536fa/0xc6b8ac1b09165d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.372490:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843438.372508:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843438.372525:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cea536fa/0xc6b8ac1b09165d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.372539:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcefe00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843438.372555:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cea536fa/0xc6b8ac1b09165d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.372927:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cea536fa/0xc6b8ac1b09165d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.372956:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cea536fa/0xc6b8ac1b09165d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.372963:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cea536fa/0xc6b8ac1b09165d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.373130:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.373133:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.373135:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843438.374746:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.374758:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008042bb26/0xc6b8ac1b09165dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.374774:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.374777:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.374783:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008042bb26/0xc6b8ac1b09165dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.374795:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008042bb26/0xc6b8ac1b09165dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.374805:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008042bb26/0xc6b8ac1b09165dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.374812:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008042bb26/0xc6b8ac1b09165dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.375373:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843438.376103:0:20134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843438.376118:0:20134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008042bb26/0xc6b8ac1b09165dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.376133:0:20134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcef600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843438.376138:0:20134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008042bb26/0xc6b8ac1b09165dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.376150:0:20134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008042bb26/0xc6b8ac1b09165dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.376175:0:20134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008042bb26/0xc6b8ac1b09165dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.376191:0:20134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008042bb26/0xc6b8ac1b09165dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.376219:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.376221:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.376223:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843438.376753:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.376763:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b9d9c68/0xc6b8ac1b09165e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.376779:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.376795:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.376801:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b9d9c68/0xc6b8ac1b09165e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.376814:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b9d9c68/0xc6b8ac1b09165e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.376824:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b9d9c68/0xc6b8ac1b09165e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.376832:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b9d9c68/0xc6b8ac1b09165e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.377119:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788843438.377789:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.377796:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afb2c055/0xc6b8ac1b09165ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.377806:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.377809:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.377814:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afb2c055/0xc6b8ac1b09165ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.377824:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afb2c055/0xc6b8ac1b09165ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.377832:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afb2c055/0xc6b8ac1b09165ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.377845:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afb2c055/0xc6b8ac1b09165ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.379413:0:20135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843438.379429:0:20135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b9d9c68/0xc6b8ac1b09165e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.379441:0:20135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcef400 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843438.379448:0:20135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b9d9c68/0xc6b8ac1b09165e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.379458:0:20135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b9d9c68/0xc6b8ac1b09165e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.379492:0:20135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b9d9c68/0xc6b8ac1b09165e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.379500:0:20135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b9d9c68/0xc6b8ac1b09165e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.379614:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843438.379629:0:20135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843438.379634:0:20135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afb2c055/0xc6b8ac1b09165ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.379642:0:20135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcee800 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843438.379645:0:20135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afb2c055/0xc6b8ac1b09165ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.379653:0:20135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afb2c055/0xc6b8ac1b09165ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.379664:0:20135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afb2c055/0xc6b8ac1b09165ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.379671:0:20135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afb2c055/0xc6b8ac1b09165ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.379693:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843438.379696:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843438.379698:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843438.381755:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.381773:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a3b48ae/0xc6b8ac1b09165f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.381789:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.381793:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.381800:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a3b48ae/0xc6b8ac1b09165f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.381813:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a3b48ae/0xc6b8ac1b09165f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.381823:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a3b48ae/0xc6b8ac1b09165f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.381831:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a3b48ae/0xc6b8ac1b09165f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.387070:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843438.388193:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843438.388456:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a3b48ae/0xc6b8ac1b09165f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.388490:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcefa00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843438.388496:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a3b48ae/0xc6b8ac1b09165f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.388508:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a3b48ae/0xc6b8ac1b09165f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.388528:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a3b48ae/0xc6b8ac1b09165f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.388536:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a3b48ae/0xc6b8ac1b09165f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.388568:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.388570:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.388572:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.389566:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843438.392304:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.392316:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011f2677/0xc6b8ac1b09165f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.392332:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.392336:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.392354:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000011f2677/0xc6b8ac1b09165f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.392369:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000011f2677/0xc6b8ac1b09165f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.392392:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011f2677/0xc6b8ac1b09165f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.392399:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000011f2677/0xc6b8ac1b09165f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.392418:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788843438.392969:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.392975:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e910d4b/0xc6b8ac1b09165ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.392984:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.392986:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.392990:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e910d4b/0xc6b8ac1b09165ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.392998:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e910d4b/0xc6b8ac1b09165ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.393006:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e910d4b/0xc6b8ac1b09165ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.393012:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e910d4b/0xc6b8ac1b09165ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.393040:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788843438.393056:0:20135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843438.393062:0:20135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000011f2677/0xc6b8ac1b09165f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.393071:0:20135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcefc00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843438.393076:0:20135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000011f2677/0xc6b8ac1b09165f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.393085:0:20135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000011f2677/0xc6b8ac1b09165f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.393101:0:20135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000011f2677/0xc6b8ac1b09165f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.394987:0:20134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843438.395002:0:20134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e910d4b/0xc6b8ac1b09165ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.395016:0:20134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcee600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843438.395021:0:20134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e910d4b/0xc6b8ac1b09165ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.395032:0:20134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e910d4b/0xc6b8ac1b09165ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.395067:0:20134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e910d4b/0xc6b8ac1b09165ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.395075:0:20134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e910d4b/0xc6b8ac1b09165ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.395101:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.395103:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.395105:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843438.395569:0:20135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000011f2677/0xc6b8ac1b09165f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.395591:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843438.395593:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843438.395595:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843438.401763:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.401779:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000251456e3/0xc6b8ac1b0916606 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.401796:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.401813:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.401820:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000251456e3/0xc6b8ac1b0916606 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.401834:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000251456e3/0xc6b8ac1b0916606 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.401843:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000251456e3/0xc6b8ac1b0916606 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.401851:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000251456e3/0xc6b8ac1b0916606 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.401876:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788843438.402849:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.402857:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acdf6582/0xc6b8ac1b091660d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.402879:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.402883:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.402888:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acdf6582/0xc6b8ac1b091660d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.402898:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acdf6582/0xc6b8ac1b091660d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.402907:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acdf6582/0xc6b8ac1b091660d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.402921:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acdf6582/0xc6b8ac1b091660d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.402936:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788843438.404665:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788843438.404677:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000251456e3/0xc6b8ac1b0916606 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.404691:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcef800 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843438.404695:0:18954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000251456e3/0xc6b8ac1b0916606 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.404706:0:18954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000251456e3/0xc6b8ac1b0916606 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.404740:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000251456e3/0xc6b8ac1b0916606 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.404748:0:18954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000251456e3/0xc6b8ac1b0916606 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.404772:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843438.404775:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acdf6582/0xc6b8ac1b091660d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.404781:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcef000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843438.404784:0:18954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acdf6582/0xc6b8ac1b091660d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.404791:0:18954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acdf6582/0xc6b8ac1b091660d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.404799:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acdf6582/0xc6b8ac1b091660d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.404805:0:18954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acdf6582/0xc6b8ac1b091660d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.404817:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843438.404818:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843438.404826:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.405564:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843438.407231:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.407245:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000716c4041/0xc6b8ac1b0916614 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.407264:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.407268:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.407275:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000716c4041/0xc6b8ac1b0916614 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.407288:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000716c4041/0xc6b8ac1b0916614 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.407299:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000716c4041/0xc6b8ac1b0916614 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.407306:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000716c4041/0xc6b8ac1b0916614 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.407332:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1788843438.411052:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788843438.412413:0:20134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843438.412438:0:20134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000716c4041/0xc6b8ac1b0916614 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.412457:0:20134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcee000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843438.412463:0:20134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000716c4041/0xc6b8ac1b0916614 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.412486:0:20134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000716c4041/0xc6b8ac1b0916614 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.412513:0:20134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000716c4041/0xc6b8ac1b0916614 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.412522:0:20134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000716c4041/0xc6b8ac1b0916614 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.412578:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.412580:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.412582:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843438.413007:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843438.413019:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee79720/0xc6b8ac1b091661b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.413047:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1788843438.413051:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843438.413057:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dee79720/0xc6b8ac1b091661b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.413070:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dee79720/0xc6b8ac1b091661b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.413080:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee79720/0xc6b8ac1b091661b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.413086:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dee79720/0xc6b8ac1b091661b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.413111:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843438.413155:0:20135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843438.413164:0:20135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dee79720/0xc6b8ac1b091661b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.413174:0:20135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fceee00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843438.413178:0:20135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee79720/0xc6b8ac1b091661b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.413189:0:20135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee79720/0xc6b8ac1b091661b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.413204:0:20135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dee79720/0xc6b8ac1b091661b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.413211:0:20135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dee79720/0xc6b8ac1b091661b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.413240:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.413242:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.413244:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843438.417525:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843438.417541:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c02dc60/0xc6b8ac1b0916622 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.417722:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788843438.417727:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843438.417735:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c02dc60/0xc6b8ac1b0916622 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.417754:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c02dc60/0xc6b8ac1b0916622 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.417767:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c02dc60/0xc6b8ac1b0916622 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.417775:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c02dc60/0xc6b8ac1b0916622 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.417867:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788843438.418424:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843438.418432:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e65063/0xc6b8ac1b0916629 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.418442:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788843438.418446:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843438.418450:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e65063/0xc6b8ac1b0916629 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.418461:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e65063/0xc6b8ac1b0916629 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.418493:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e65063/0xc6b8ac1b0916629 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.418500:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e65063/0xc6b8ac1b0916629 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.436433:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843438.436437:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788843438.436451:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e65063/0xc6b8ac1b0916629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.436488:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42697200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843438.436494:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e65063/0xc6b8ac1b0916629 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.436508:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e65063/0xc6b8ac1b0916629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.436560:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e65063/0xc6b8ac1b0916629 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.436568:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e65063/0xc6b8ac1b0916629 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.436598:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843438.436600:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843438.436602:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843438.437274:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843438.437287:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000645dc08e/0xc6b8ac1b0916630 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.437305:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788843438.437311:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843438.437318:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000645dc08e/0xc6b8ac1b0916630 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.437334:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000645dc08e/0xc6b8ac1b0916630 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.437376:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000645dc08e/0xc6b8ac1b0916630 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.437384:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000645dc08e/0xc6b8ac1b0916630 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.437420:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788843438.437636:0:20132:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:34 00000100:00100000:0.0:1788843438.437775:0:20132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18988:x1875737795750400:12345-0@lo:5:osp-pre-0-0.0 Request processed in 191249us (191920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843438.437792:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788843438.438237:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788843438.438250:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c02dc60/0xc6b8ac1b0916622 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.438262:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42696600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843438.438266:0:18954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c02dc60/0xc6b8ac1b0916622 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.438279:0:18954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c02dc60/0xc6b8ac1b0916622 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.438299:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c02dc60/0xc6b8ac1b0916622 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843438.438307:0:18954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c02dc60/0xc6b8ac1b0916622 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.438629:0:20134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843438.438642:0:20134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000645dc08e/0xc6b8ac1b0916630 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.438654:0:20134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42697800 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843438.438659:0:20134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000645dc08e/0xc6b8ac1b0916630 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.438669:0:20134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000645dc08e/0xc6b8ac1b0916630 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.438690:0:20134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000645dc08e/0xc6b8ac1b0916630 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843438.438699:0:20134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000645dc08e/0xc6b8ac1b0916630 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843438.438737:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.438744:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843438.438747:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843438.438753:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843438.438757:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843438.438759:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843438.438838:0:18988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a78000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18988:1875737795750400:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788843438.438853:0:18988:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x22:0x0] 00000100:00100000:1.0:1788843438.438899:0:18988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18988:1875737795750528:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788843438.438962:0:18988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843438.439024:0:18988:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51592540 going to sleep for 11 seconds 00000100:00100000:0.0:1788843438.439182:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795750528 00000100:00100000:0.0:1788843438.439195:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795750528 00000100:00100000:0.0:1788843438.439333:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843438.439366:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:18988:x1875737795750528:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788843438.439425:0:19651:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00000100:00100000:1.0:1788843438.447252:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:18988:x1875737795750528:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7904us (8284us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788843438.447265:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843438.450888:0:18988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18988:1875737795750528:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788843438.450911:0:18988:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00010000:00010000:0.0:1788843439.364690:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788843439.588631:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1788843439.588667:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788843440.389491:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843441.414150:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843442.440432:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843443.462203:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788843443.525667:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843443.525676:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788843443.525682:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dab7772f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843443.525694:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 562 00000100:00080000:3.0:1788843443.525702:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788843443.525711:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dab7772f800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1788843443.525742:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab43780a80 x1875737795750912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788843443.525834:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795750784:0@lo:400:kworker.0 00000100:00100000:3.0:1788843443.525947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843443.526027:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843443.526035:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:345dfd18-3e4c-44c0-bf46-62bd805326d9:3305:1875737795750656:0@lo:400:kworker.0 00000100:00100000:3.0:1788843443.526074:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843443.526110:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795751168:0@lo:400:kworker.0 00000100:00100000:3.0:1788843443.526141:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843443.526160:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843443.526165:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795751040:0@lo:400:kworker.0 00000100:00100000:3.0:1788843443.526187:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843443.526221:0:19650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795750784 00000100:00100000:3.0:1788843443.526230:0:19650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795750784 00000100:00100000:3.0:1788843443.526292:0:19650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843443.526303:0:19650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795750784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843443.526406:0:19650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795750784:12345-0@lo:400:kworker.0 Request processed in 104us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843443.526413:0:19650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843443.526441:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795750656 00000100:00100000:3.0:1788843443.526458:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795750656 00000100:00100000:3.0:1788843443.526486:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788843443.526493:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:3305:x1875737795750656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843443.526531:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:3305:x1875737795750656:12345-0@lo:400:kworker.0 Request processed in 37us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843443.526538:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788843443.526577:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795751168 00000100:00100000:3.0:1788843443.526590:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795751168 00000100:00100000:3.0:1788843443.526627:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795751040 00000100:00100000:3.0:1788843443.526631:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795751040 00000100:00100000:3.0:1788843443.526647:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788843443.526653:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795751168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843443.526692:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795751168:12345-0@lo:400:kworker.0 Request processed in 39us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843443.526699:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788843443.526711:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788843443.526717:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795751040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843443.526743:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795751040:12345-0@lo:400:kworker.0 Request processed in 27us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843443.526749:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788843443.526771:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843443.526776:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788843443.526811:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab43780e00 x1875737795751040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843443.526825:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795751040:0@lo:400:kworker.0 00010000:00080000:3.0:1788843443.526836:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab43783800 x1875737795751168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843443.526844:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795751168:0@lo:400:kworker.0 00000100:00100000:3.0:1788843443.526980:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:345dfd18-3e4c-44c0-bf46-62bd805326d9:3305:1875737795750656:0@lo:400:kworker.0 00000100:00100000:3.0:1788843443.526991:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788843443.527003:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795750784:0@lo:400:kworker.0 00000100:00100000:0.0:1788843443.531258:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795750912:0@lo:8:kworker.0 00000100:00100000:0.0:1788843443.531376:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843443.532818:0:20132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795750912 00000100:00100000:0.0:1788843443.532835:0:20132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795750912 00000100:00100000:0.0:1788843443.532886:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788843443.532905:0:20132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3303:x1875737795750912:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788843443.532933:0:20132:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788843443.534312:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795751296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843443.534406:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843443.534559:0:19653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795751296 00000100:00100000:3.0:1788843443.534576:0:19653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795751296 00000100:00100000:3.0:1788843443.534641:0:19653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843443.534652:0:19653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795751296:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843443.534652:0:19654:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788843443.534666:0:19654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1788843443.534714:0:19653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788843443.534782:0:19653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795751296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843443.534791:0:19653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843443.536064:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795751296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843443.543590:0:20132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3303:x1875737795750912:12345-0@lo:8:kworker.0 Request processed in 10678us (12207us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788843443.543604:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788843443.543750:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab7772f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788843443.543755:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788843443.543759:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795750912:0@lo:8:kworker.0 00000020:01000004:0.0:1788843443.876953:0:20374:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788843443.876959:0:20374:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788843443.877179:0:20374:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dab6fd9c000 00000020:01000004:0.0:1788843443.877204:0:20374:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788843443.877221:0:20374:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788843443.877240:0:20374:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8dab75270000) 00000020:00000080:0.0:1788843443.877262:0:20374:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788843443.908142:0:20374:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788843443.916932:0:20374:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788843443.918180:0:20374:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788843443.918498:0:20374:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788843443.918768:0:20374:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:1.0:1788843443.919193:0:20374:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 249: rc = 0 00100000:10000000:1.0:1788843443.919291:0:20374:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 249: rc = 0 00100000:10000000:1.0:1788843443.919426:0:20374:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 249: rc = 0 00100000:10000000:1.0:1788843443.919883:0:20374:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 642: rc = 0 00100000:10000000:1.0:1788843443.920154:0:20374:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:1.0:1788843443.924772:0:20374:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 642: rc = 0 00100000:10000000:1.0:1788843443.926502:0:20374:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 642: rc = 0 00100000:10000000:1.0:1788843443.926831:0:20374:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 642: rc = 0 00100000:10000000:1.0:1788843443.928433:0:20374:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 642: rc = 0 00000020:00000080:1.0:1788843443.930433:0:20374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788843443.930462:0:20374:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788843443.930479:0:20374:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc6b8ac1b091663e 00000020:01000004:1.0:1788843443.930489:0:20374:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788843443.930519:0:20374:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788843443.930524:0:20374:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788843443.930531:0:20374:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788843443.930570:0:20374:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788843443.930575:0:20374:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788843443.962254:0:20374:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788843443.962315:0:20374:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.129@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788843443.962320:0:20374:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788843443.962322:0:20374:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843443.962324:0:20374:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843443.962325:0:20374:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843443.962334:0:20374:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843443.962335:0:20374:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843443.962336:0:20374:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843443.962409:0:20374:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843443.962412:0:20374:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788843443.962416:0:20374:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788843443.962419:0:20374:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788843443.962420:0:20374:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843443.962421:0:20374:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843443.962422:0:20374:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843443.962423:0:20374:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843443.962424:0:20374:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843443.962424:0:20374:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843443.962425:0:20374:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843443.962426:0:20374:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788843443.962490:0:20374:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788843443.962519:0:20374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795751424:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788843443.962615:0:20374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843443.962735:0:20374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab603b7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788843443.966400:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795751424 00000100:00100000:1.0:1788843443.966423:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795751424 00000100:00100000:2.0:1788843443.969465:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788843443.969486:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:20374:x1875737795751424:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788843443.969539:0:18959:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788843443.969543:0:18959:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788843443.969548:0:18959:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788843443.981593:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:20374:x1875737795751424:12345-0@lo:253:mount.lustre.0 Request processed in 12097us (18962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843443.981616:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788843443.985196:0:20374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795751424:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788843443.985227:0:20374:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788843443.985231:0:20374:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788843443.985232:0:20374:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788843443.985234:0:20374:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843443.985235:0:20374:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843443.985236:0:20374:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843443.985237:0:20374:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843443.985239:0:20374:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843443.985242:0:20374:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843443.985243:0:20374:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788843443.985286:0:20374:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dab6fd9c000 from lustre-OST0001 10000000:01000000:3.0:1788843443.985322:0:20374:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788843443.985326:0:20374:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788843443.985337:0:20374:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dab6f873370 local copy 00010000:00010000:3.0:1788843443.985372:0:20374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8daa42696800/0xc6b8ac1b09163cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09163d6 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843443.985731:0:20374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43782a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795751552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843443.985810:0:20374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843443.987780:0:20374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab5169b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788843443.989008:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795751552 00000100:00100000:0.0:1788843443.989026:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795751552 00000100:00100000:0.0:1788843443.989194:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788843443.989207:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:20374:x1875737795751552:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843443.991020:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:20374:x1875737795751552:12345-0@lo:501:mount.lustre.0 Request processed in 1805us (5198us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788843443.991036:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788843443.991191:0:20374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43782a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795751552:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788843443.991222:0:20374:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788843443.991501:0:20374:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788843443.991515:0:20374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8daa42696800/0xc6b8ac1b09163cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09163d6 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843443.991528:0:20374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8daa42696800/0xc6b8ac1b09163cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09163d6 expref: -99 pid: 18947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843443.991562:0:20374:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dab6fd9c000 10000000:01000000:3.0:1788843443.991568:0:20374:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788843443.991576:0:20374:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788843443.991579:0:20374:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788843443.991585:0:20374:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788843443.991589:0:20374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788843443.991634:0:20374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41532a00/0xc6b8ac1b0916645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843443.991643:0:20374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab41532a00/0xc6b8ac1b0916645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843443.991656:0:20374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab41532a00/0xc6b8ac1b0916645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843443.991680:0:20374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43782a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795751680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788843443.991736:0:20374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843443.991791:0:20374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab5169b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788843443.991984:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795751680 00000100:00100000:0.0:1788843443.991992:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795751680 00000100:00100000:0.0:1788843443.992040:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788843443.992967:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:20374:x1875737795751680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843443.992998:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843443.993025:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8daa42697c00/0xc6b8ac1b091664c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0916645 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843443.993145:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8daa42697c00/0xc6b8ac1b091664c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0916645 expref: 17 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843443.993157:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8daa42697c00/0xc6b8ac1b091664c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0916645 expref: 17 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843443.993167:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8daa42697c00, rc 0) 00000100:00100000:0.0:1788843443.993313:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+17:20374:x1875737795751680:12345-0@lo:101:mount.lustre.0 Request processed in 1264us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843443.993322:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788843443.996213:0:20374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43782a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795751680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843443.996256:0:20374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab41532a00/0xc6b8ac1b0916645 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b091664c expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843443.996273:0:20374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab41532a00/0xc6b8ac1b0916645 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b091664c expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788843443.998680:0:20374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1788843444.002828:0:20374:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843444.005174:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788843444.005241:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788843444.005281:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788843444.005332:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788843444.005403:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788843444.005453:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788843444.005514:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788843444.005557:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788843444.005605:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1788843444.005673:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1788843444.005681:0:20374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1788843444.005819:0:20374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795751808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843444.005919:0:20374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843444.005984:0:20374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4aa1e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788843444.006256:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795751808 00000100:00100000:0.0:1788843444.006267:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795751808 00000100:00100000:0.0:1788843444.006377:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788843444.006389:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+17:20374:x1875737795751808:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843444.007797:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+17:20374:x1875737795751808:12345-0@lo:501:mount.lustre.0 Request processed in 1403us (1870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843444.007811:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788843444.008042:0:20374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795751808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843444.008182:0:20374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795751936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843444.008247:0:20374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843444.008366:0:20374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4aa1e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788843444.008435:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795751936 00000100:00100000:0.0:1788843444.008453:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795751936 00000100:00100000:1.0:1788843444.012404:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788843444.012451:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+17:20374:x1875737795751936:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843444.013279:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+17:20374:x1875737795751936:12345-0@lo:503:mount.lustre.0 Request processed in 854us (5028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843444.013292:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788843444.013645:0:20374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795751936:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788843444.016207:0:20374:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788843444.016617:0:20374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795752064:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843444.016728:0:20374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843444.016828:0:20374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4aa1e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788843444.022033:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795752064 00000100:00100000:0.0:1788843444.022065:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795752064 00000100:00100000:0.0:1788843444.022154:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788843444.022167:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+17:20374:x1875737795752064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843444.022631:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+17:20374:x1875737795752064:12345-0@lo:502:mount.lustre.0 Request processed in 465us (5902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843444.022640:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788843444.022914:0:20374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795752064:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788843444.023239:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788843444.023293:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788843444.023320:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788843444.023399:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788843444.023450:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788843444.023488:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788843444.023536:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788843444.023573:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788843444.023623:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1788843444.023673:0:20374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795752192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843444.023742:0:20374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843444.023796:0:20374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4aa1e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788843444.024035:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795752192 00000100:00100000:1.0:1788843444.024056:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795752192 00000100:00100000:1.0:1788843444.024113:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788843444.024123:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+17:20374:x1875737795752192:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843444.024327:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+17:20374:x1875737795752192:12345-0@lo:502:mount.lustre.0 Request processed in 205us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843444.024381:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788843444.024566:0:20374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795752192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788843444.024655:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1788843444.024667:0:20374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788843444.030628:0:20376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788843444.030648:0:20376:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788843444.030658:0:20376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843444.030661:0:20376:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788843444.030671:0:20376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788843444.030694:0:20376:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8dab6f870000) 00000020:00000080:1.0:1788843444.030724:0:20376:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788843444.030731:0:20376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788843444.030841:0:20376:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dab6fd9c000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788843444.031968:0:20376:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788843444.031993:0:20376:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc6b8ac1b091665a 00010000:00010000:1.0:1788843444.043054:0:20376:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788843444.043587:0:20376:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934593 00080000:10000000:1.0:1788843444.052944:0:20376:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1788843444.062593:0:20376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788843444.062611:0:20376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843444.062620:0:20376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843444.062623:0:20376:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788843444.062627:0:20376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843444.062632:0:20376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843444.062633:0:20376:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788843444.062636:0:20376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788843444.062639:0:20376:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788843444.062640:0:20376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843444.062643:0:20376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843444.062644:0:20376:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788843444.062646:0:20376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843444.062648:0:20376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843444.062649:0:20376:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788843444.062652:0:20376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788843444.062833:0:20376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843444.062854:0:20376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843444.062856:0:20376:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788843444.062860:0:20376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1788843444.064587:0:20374:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788843444.064923:0:20374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788843444.064958:0:20374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41532a00/0xc6b8ac1b0916645 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b091664c expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.064970:0:20374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab41532a00/0xc6b8ac1b0916645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b091664c expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843444.064979:0:20374:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab6fd9c000 from 1 10000000:01000000:2.0:1788843444.064982:0:20374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788843444.065021:0:20374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89200/0xc6b8ac1b0916661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.065029:0:20374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89200/0xc6b8ac1b0916661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.065054:0:20374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89200/0xc6b8ac1b0916661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843444.065083:0:20374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795752320:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788843444.065151:0:20374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843444.065200:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795752320 00000100:00100000:2.0:1788843444.065207:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795752320 00000100:00100000:2.0:1788843444.065254:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788843444.065268:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+17:20374:x1875737795752320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843444.065280:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843444.065294:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7ff89600/0xc6b8ac1b0916668 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0916661 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.066537:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff89600/0xc6b8ac1b0916668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0916661 expref: 18 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.066552:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7ff89600/0xc6b8ac1b0916668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0916661 expref: 18 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.066561:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89600, rc 0) 00000100:00100000:2.0:1788843444.066625:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+18:20374:x1875737795752320:12345-0@lo:101:mount.lustre.0 Request processed in 1362us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843444.066634:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788843444.066705:0:20374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4aa1e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843444.066731:0:20374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795752320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843444.066747:0:20374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89200/0xc6b8ac1b0916661 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916668 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.066768:0:20374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89200/0xc6b8ac1b0916661 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0916668 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788843444.067543:0:20374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:2.0:1788843444.068326:0:20374:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843444.068602:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788843444.068648:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788843444.068716:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788843444.068756:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788843444.068797:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788843444.068851:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788843444.068889:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788843444.068923:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788843444.068987:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788843444.068995:0:20374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:2.0:1788843444.069074:0:20374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795752448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843444.069137:0:20374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843444.069199:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795752448 00000100:00100000:2.0:1788843444.069205:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795752448 00000100:00100000:2.0:1788843444.069244:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788843444.069253:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+18:20374:x1875737795752448:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843444.071437:0:20374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4aa1e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843444.075839:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+18:20374:x1875737795752448:12345-0@lo:501:mount.lustre.0 Request processed in 6576us (6691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843444.075857:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788843444.075949:0:20374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795752448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843444.076031:0:20374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795752576:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843444.076099:0:20374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843444.076133:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795752576 00000100:00100000:2.0:1788843444.076139:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795752576 00000100:00100000:2.0:1788843444.076174:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788843444.076182:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab492f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+18:20374:x1875737795752576:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843444.078685:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab492f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+18:20374:x1875737795752576:12345-0@lo:503:mount.lustre.0 Request processed in 2495us (2577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843444.078698:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788843444.078898:0:20374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4aa1e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843444.078923:0:20374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795752576:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788843444.079632:0:20374:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788843444.079718:0:20374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795752704:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843444.079787:0:20374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843444.079829:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795752704 00000100:00100000:2.0:1788843444.079834:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795752704 00000100:00100000:2.0:1788843444.079873:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788843444.079882:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab492f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+18:20374:x1875737795752704:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843444.080097:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab492f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+18:20374:x1875737795752704:12345-0@lo:502:mount.lustre.0 Request processed in 216us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843444.080105:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788843444.080164:0:20374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4aa1e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843444.080180:0:20374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795752704:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788843444.080422:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788843444.084728:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788843444.084839:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788843444.084900:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788843444.084976:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788843444.087700:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788843444.087817:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788843444.088002:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:3.0:1788843444.088242:0:20374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43781f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795752832:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843444.088492:0:20374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843444.088606:0:20374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6e76b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788843444.088660:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795752832 00000100:00100000:0.0:1788843444.088671:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795752832 00000100:00100000:0.0:1788843444.088763:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788843444.088775:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab492f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+18:20374:x1875737795752832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843444.089059:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab492f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+18:20374:x1875737795752832:12345-0@lo:502:mount.lustre.0 Request processed in 275us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843444.089069:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788843444.089254:0:20374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43781f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795752832:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788843444.089466:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788843444.089483:0:20374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788843444.090966:0:20381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843444.090981:0:20381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843444.090984:0:20381:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788843444.090995:0:20381:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dab6fd9c000 00000020:00000080:1.0:1788843444.090998:0:20381:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788843444.091010:0:20381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843444.091013:0:20381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843444.091014:0:20381:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788843444.091018:0:20381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843444.091021:0:20381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843444.091023:0:20381:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788843444.091029:0:20381:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dab6fd9c000 00000020:00000080:1.0:1788843444.091031:0:20381:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788843444.091181:0:20381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843444.091187:0:20381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843444.091188:0:20381:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788843444.091193:0:20381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843444.091196:0:20381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843444.091198:0:20381:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788843444.091203:0:20381:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dab6fd9c000 00000020:00000080:1.0:1788843444.091207:0:20381:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788843444.091299:0:20381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843444.091303:0:20381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843444.091305:0:20381:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788843444.091308:0:20381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:0.0:1788843444.100281:0:20374:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788843444.100364:0:20374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788843444.100395:0:20374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89200/0xc6b8ac1b0916661 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916668 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843444.100411:0:20374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89200/0xc6b8ac1b0916661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916668 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843444.100486:0:20374:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788843444.100490:0:20374:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dab6fd9c000 10000000:01000000:0.0:1788843444.100494:0:20374:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dab6fd9c000 10000000:01000000:0.0:1788843444.100499:0:20374:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788843444.100506:0:20374:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dab6fd9c000 from 1 10000000:01000000:0.0:1788843444.100508:0:20374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788843444.100559:0:20374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8daa42696000/0xc6b8ac1b091666f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843444.100569:0:20374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8daa42696000/0xc6b8ac1b091666f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843444.100582:0:20374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8daa42696000/0xc6b8ac1b091666f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843444.100655:0:20374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795752960:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788843444.101939:0:20374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843444.102005:0:20374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51592b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843444.102768:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795752960 00000100:00100000:2.0:1788843444.102783:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795752960 00000100:00100000:2.0:1788843444.102845:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788843444.102879:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab492f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+18:20374:x1875737795752960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843444.102896:0:18959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843444.102914:0:18959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7ff89a00/0xc6b8ac1b0916676 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b091666f expref: -99 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.102946:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff89a00/0xc6b8ac1b0916676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b091666f expref: 19 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.102958:0:18959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7ff89a00/0xc6b8ac1b0916676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b091666f expref: 19 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.102968:0:18959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89a00, rc 0) 00000100:00100000:2.0:1788843444.103048:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab492f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:20374:x1875737795752960:12345-0@lo:101:mount.lustre.0 Request processed in 194us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843444.104170:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788843444.105132:0:20374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795752960:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843444.105157:0:20374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8daa42696000/0xc6b8ac1b091666f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916676 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.105168:0:20374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8daa42696000/0xc6b8ac1b091666f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0916676 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788843444.107246:0:20374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:2.0:1788843444.108158:0:20374:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843444.109829:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788843444.109929:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788843444.109981:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788843444.111251:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788843444.111425:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788843444.111516:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788843444.111576:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788843444.111628:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788843444.111696:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788843444.111745:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788843444.111793:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788843444.111857:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788843444.111910:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788843444.111987:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788843444.112043:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788843444.112081:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788843444.112119:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788843444.112170:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788843444.112209:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788843444.112243:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788843444.112291:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788843444.112327:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788843444.112403:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788843444.112467:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788843444.112507:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:2.0:1788843444.112541:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:2.0:1788843444.112589:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:2.0:1788843444.112628:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:2.0:1788843444.112662:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:2.0:1788843444.112735:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:2.0:1788843444.112772:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:2.0:1788843444.112804:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:2.0:1788843444.112838:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:2.0:1788843444.112887:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:2.0:1788843444.112942:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:2.0:1788843444.113037:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:2.0:1788843444.113085:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:2.0:1788843444.113116:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:2.0:1788843444.113161:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:2.0:1788843444.113199:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:2.0:1788843444.113333:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:2.0:1788843444.113387:0:20374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:2.0:1788843444.116135:0:20374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795753088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843444.116210:0:20374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843444.116287:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795753088 00000100:00100000:2.0:1788843444.116296:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795753088 00000100:00100000:2.0:1788843444.116837:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788843444.116849:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab492f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:20374:x1875737795753088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843444.120663:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab492f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:20374:x1875737795753088:12345-0@lo:501:mount.lustre.0 Request processed in 3807us (4444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843444.120677:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788843444.120768:0:20374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69916180 going to sleep for 11 seconds 00000100:00100000:2.0:1788843444.120794:0:20374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795753088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843444.120843:0:20374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795753216:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843444.120892:0:20374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843444.120927:0:20374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69916180 going to sleep for 11 seconds 00000100:00100000:3.0:1788843444.121748:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795753216 00000100:00100000:3.0:1788843444.121766:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795753216 00000100:00100000:3.0:1788843444.121827:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788843444.121840:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab820e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:20374:x1875737795753216:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843444.122266:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab820e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:20374:x1875737795753216:12345-0@lo:503:mount.lustre.0 Request processed in 426us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843444.122275:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788843444.122385:0:20374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795753216:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788843444.123337:0:20374:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788843444.123494:0:20374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43783800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795753344:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843444.123575:0:20374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843444.123622:0:20374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4a91b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843444.123849:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795753344 00000100:00100000:2.0:1788843444.123857:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795753344 00000100:00100000:2.0:1788843444.123910:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788843444.123921:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab820e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:20374:x1875737795753344:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843444.124269:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab820e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:20374:x1875737795753344:12345-0@lo:502:mount.lustre.0 Request processed in 348us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843444.124286:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788843444.127633:0:20374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43783800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795753344:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843444.127998:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788843444.128081:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788843444.128122:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788843444.128176:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788843444.128215:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788843444.128278:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788843444.128329:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788843444.129948:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788843444.130070:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788843444.130114:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788843444.130152:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788843444.130211:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788843444.130250:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788843444.130284:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788843444.130375:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788843444.130419:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788843444.130477:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788843444.130537:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788843444.130581:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788843444.130619:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788843444.130668:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788843444.130712:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788843444.130766:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788843444.130838:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788843444.130892:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:3.0:1788843444.130930:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:3.0:1788843444.130995:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:3.0:1788843444.131038:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:3.0:1788843444.131089:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:3.0:1788843444.131173:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:3.0:1788843444.131236:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:3.0:1788843444.134533:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:3.0:1788843444.134701:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:3.0:1788843444.134814:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:3.0:1788843444.134855:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:3.0:1788843444.134932:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:3.0:1788843444.134972:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:3.0:1788843444.135006:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:3.0:1788843444.135053:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:3.0:1788843444.135091:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:3.0:1788843444.135160:0:20374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43783800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795753472:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843444.135266:0:20374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843444.135362:0:20374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4433a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788843444.135819:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795753472 00000100:00100000:0.0:1788843444.135831:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795753472 00000100:00100000:0.0:1788843444.135892:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788843444.135904:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab820e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:20374:x1875737795753472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843444.136262:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab820e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:20374:x1875737795753472:12345-0@lo:502:mount.lustre.0 Request processed in 358us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843444.136271:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788843444.136471:0:20374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43783800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795753472:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843444.136587:0:20374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:3.0:1788843444.136613:0:20374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788843444.139258:0:20386:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788843444.139283:0:20386:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8dab477d99b8) 00000020:00000080:2.0:1788843444.139311:0:20386:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788843444.139471:0:20386:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dab6fd9c000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788843444.139477:0:20386:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dab6fd9c000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788843444.139480:0:20386:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab6fd9c000 3 00010000:00080000:2.0:1788843444.139518:0:20386:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8daa42060800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1788843444.143365:0:20386:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788843444.143652:0:20386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788843444.143705:0:20386:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788843444.143724:0:20386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc6b8ac1b0916684 00000100:00080000:2.0:1788843444.143738:0:20386:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788843444.143745:0:20386:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8daa42060800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1788843444.143793:0:20386:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab73a7ad80 x1875737795753600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843444.143896:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875737795753600:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788843444.143997:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843444.144664:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795753600 00000100:00100000:3.0:1788843444.144676:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795753600 00000100:00100000:3.0:1788843444.144722:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843444.144732:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875737795753600:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788843444.144766:0:18967:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:3.0:1788843444.144810:0:18967:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc6b8ac1b091668b 00000004:00100000:3.0:1788843444.144831:0:18967:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788843444.144874:0:18967:0:(import.c:65:import_set_state_nolock()) ffff8dab7fd0f000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788843444.145064:0:20386:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788843444.145126:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843444.145130:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788843444.145133:0:38:0:(import.c:65:import_set_state_nolock()) ffff8dab7772f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788843444.145138:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 567 00000100:00080000:2.0:1788843444.145142:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788843444.145147:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dab7772f800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1788843444.145166:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab73a79f80 x1875737795753856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843444.145245:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795753856:0@lo:8:kworker.0 00000100:00100000:0.0:1788843444.145289:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843444.148681:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875737795753600:12345-0@lo:38:llog_process_th.0 Request processed in 3933us (4668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843444.148702:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843444.148802:0:19650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795753856 00000100:00100000:3.0:1788843444.148814:0:19650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795753856 00000100:00100000:3.0:1788843444.148936:0:19650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843444.148946:0:19650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875737795753856:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788843444.149049:0:19650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875737795753856:12345-0@lo:8:kworker.0 Request processed in 102us (3760us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788843444.149056:0:19650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843444.149551:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795753984:0@lo:400:kworker.0 00000100:00100000:3.0:1788843444.149610:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843444.149649:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843444.149655:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795754112:0@lo:400:kworker.0 00000100:00100000:3.0:1788843444.149683:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843444.149743:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795753984 00000100:00100000:2.0:1788843444.149756:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795753984 00000100:00100000:2.0:1788843444.149798:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795754112 00000100:00100000:2.0:1788843444.149801:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795754112 00000100:00100000:2.0:1788843444.149824:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843444.149834:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795753984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843444.149904:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795753984:12345-0@lo:400:kworker.0 Request processed in 74us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843444.149912:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843444.149929:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843444.149936:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795754112:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788843444.150092:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab73a7ad80 x1875737795753600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843444.150107:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788843444.150119:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1788843444.150131:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788843444.150137:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788843444.150141:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8daa42060800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788843444.150151:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875737795753600:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788843444.150183:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788843444.150188:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab7772f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788843444.150201:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788843444.150205:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795753856:0@lo:8:kworker.0 00000100:00100000:1.0:1788843444.151099:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795753728:0@lo:400:kworker.0 00000100:00100000:1.0:1788843444.151173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843444.151259:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795753728 00000100:00100000:1.0:1788843444.151266:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795753728 00000100:00100000:1.0:1788843444.151309:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843444.151318:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795753728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843444.151399:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795753728:12345-0@lo:400:kworker.0 Request processed in 81us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843444.151406:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843444.151461:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795753728:0@lo:400:kworker.0 00000100:00100000:2.0:1788843444.154695:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795754112:12345-0@lo:400:kworker.0 Request processed in 4743us (4995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843444.154714:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000040:00080000:2.0:1788843444.155011:0:20386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:2.0:1788843444.158432:0:20374:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788843444.158504:0:20374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788843444.158535:0:20374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8daa42696000/0xc6b8ac1b091666f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916676 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.158553:0:20374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8daa42696000/0xc6b8ac1b091666f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916676 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788843444.158619:0:20374:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788843444.158622:0:20374:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843444.158623:0:20374:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843444.158625:0:20374:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843444.158626:0:20374:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843444.158628:0:20374:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843444.158629:0:20374:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843444.158631:0:20374:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843444.158633:0:20374:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788843444.158645:0:20374:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788843444.158648:0:20374:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788843444.158649:0:20374:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843444.158650:0:20374:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843444.158651:0:20374:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843444.158652:0:20374:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843444.158653:0:20374:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843444.158654:0:20374:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843444.158655:0:20374:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843444.158656:0:20374:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788843444.158692:0:20374:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788843444.158719:0:20374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795754240:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788843444.158820:0:20374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843444.158952:0:20374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69916780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843444.159009:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795754240 00000100:00100000:0.0:1788843444.159020:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795754240 00010000:00080000:3.0:1788843444.159060:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab73a78a80 x1875737795754112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843444.159076:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795754112:0@lo:400:kworker.0 00000100:00100000:0.0:1788843444.159085:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788843444.159101:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:20374:x1875737795754240:12345-0@lo:253:mount.lustre.0 00010000:00080000:3.0:1788843444.159107:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab73a79500 x1875737795753984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843444.159118:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795753984:0@lo:400:kworker.0 20000000:01000000:0.0:1788843444.159138:0:18959:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788843444.159158:0:18959:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788843444.178318:0:18959:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788843444.178416:0:18959:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788843444.178472:0:18981:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788843444.178478:0:18981:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788843444.178507:0:18981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0916692 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.178530:0:18981:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab7ff89400/0xc6b8ac1b0916550 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0916549 expref: 19 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.178540:0:18981:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0916692 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.178591:0:18981:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab7ff89400/0xc6b8ac1b0916550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0916549 expref: 19 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.178607:0:18981:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab7ff89400/0xc6b8ac1b0916550 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0916549 expref: 19 pid: 18960 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843444.178625:0:18981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a79880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18981:1875737795754368:0@lo:104: 00000100:00100000:2.0:1788843444.178711:0:18981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843444.178820:0:18981:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69916180 going to sleep for 11 seconds 00000100:00100000:0.0:1788843444.178927:0:18949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795754368 00000100:00100000:0.0:1788843444.178937:0:18949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795754368 00000100:00100000:0.0:1788843444.178999:0:18949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843444.179010:0:18949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:345dfd18-3e4c-44c0-bf46-62bd805326d9+3:18981:x1875737795754368:12345-0@lo:104: 00010000:00010000:0.0:1788843444.179024:0:18949:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0916549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0916550 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843444.179083:0:18949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788843444.179090:0:18949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:345dfd18-3e4c-44c0-bf46-62bd805326d9+3:18981:x1875737795754368:12345-0@lo:104: Request processed in 82us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843444.179097:0:18949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788843444.179152:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843444.179159:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0916549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0916550 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.179169:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4400 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:2.0:1788843444.179173:0:18953:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0916549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0916550 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.179183:0:18953:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0916549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0916550 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843444.179192:0:18953:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0916549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0916550 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843444.179199:0:18953:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788843444.179228:0:18953:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0916549 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0916550 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.179235:0:18953:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843444.179260:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0916549 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0916550 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.179267:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0916549 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0916550 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843444.179283:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843444.179286:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843444.179288:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843444.179318:0:18981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a79880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18981:1875737795754368:0@lo:104: 00010000:00010000:2.0:1788843444.179360:0:18981:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0916692 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843444.179377:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:345dfd18-3e4c-44c0-bf46-62bd805326d9:3304:1875737795754496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843444.179414:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843444.179450:0:18950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795754496 00000100:00100000:0.0:1788843444.179455:0:18950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795754496 00010000:00010000:0.0:1788843444.179472:0:18950:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab7ff89400/0xc6b8ac1b0916550 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0916549 expref: 20 pid: 18960 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843444.179527:0:18950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843444.179535:0:18950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:345dfd18-3e4c-44c0-bf46-62bd805326d9+20:3304:x1875737795754496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843444.179556:0:18950:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843444.179563:0:18950:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab7ff89400/0xc6b8ac1b0916550 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0916549 expref: 20 pid: 18960 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843444.179573:0:18950:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab7ff89400/0xc6b8ac1b0916550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0916549 expref: 20 pid: 18960 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843444.179588:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7ff89400/0xc6b8ac1b0916550 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0916549 expref: 20 pid: 18960 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843444.179602:0:18950:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0916692 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843444.179611:0:18950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0916692 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788843444.179624:0:18950:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009068949s 00010000:00010000:0.0:1788843444.179629:0:18950:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0916692 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843444.179636:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0916692 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843444.179644:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0916692 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843444.179650:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0916692 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843444.179656:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88c00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843444.179661:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0916692 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843444.179675:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0916692 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843444.179688:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0916692 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843444.179697:0:18950:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843444.179724:0:18950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:3304:x1875737795754496:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843444.179732:0:18950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788843444.179755:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:345dfd18-3e4c-44c0-bf46-62bd805326d9:3304:1875737795754496:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843444.179775:0:18981:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0916692 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843444.179783:0:18981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0916692 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843444.179790:0:18981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0916692 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843444.188617:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+18:20374:x1875737795754240:12345-0@lo:253:mount.lustre.0 Request processed in 29497us (29775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843444.188639:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788843444.188930:0:20374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:345dfd18-3e4c-44c0-bf46-62bd805326d9:20374:1875737795754240:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788843444.188951:0:20374:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788843444.188954:0:20374:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788843444.188957:0:20374:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843444.188959:0:20374:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843444.188960:0:20374:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843444.188962:0:20374:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843444.188963:0:20374:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843444.188965:0:20374:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843444.188967:0:20374:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843444.188968:0:20374:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788843444.189058:0:20374:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788843444.190127:0:20374:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788843444.190526:0:20374:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788843444.190939:0:20374:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788843444.191250:0:20374:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788843444.191779:0:20374:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788843444.192260:0:20374:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788843444.193540:0:20374:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788843444.301413:0:20374:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788843444.301428:0:20374:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788843444.301486:0:20374:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788843444.301566:0:20374:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788843444.301592:0:20374:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788843444.301633:0:20374:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788843444.484578:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788843445.444444:0:18962:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788843445.444454:0:18962:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dab7c18f800 from 11 10000000:01000000:0.0:1788843445.444461:0:18962:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788843445.444520:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8daa42696200/0xc6b8ac1b0916699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843445.444534:0:18962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8daa42696200/0xc6b8ac1b0916699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843445.444549:0:18962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8daa42696200/0xc6b8ac1b0916699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843445.444582:0:18962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795754624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843445.444992:0:18962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843445.445061:0:18962:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7793a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843445.445152:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795754624 00000100:00100000:2.0:1788843445.445171:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795754624 00000100:00100000:2.0:1788843445.445244:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788843445.445255:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+18:18962:x1875737795754624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843445.445273:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843445.445295:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7ff88a00/0xc6b8ac1b09166a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0916699 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843445.445326:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff88a00/0xc6b8ac1b09166a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0916699 expref: 19 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843445.445370:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7ff88a00/0xc6b8ac1b09166a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0916699 expref: 19 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843445.445396:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88a00, rc 0) 00000100:00100000:2.0:1788843445.445710:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:18962:x1875737795754624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 455us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843445.445717:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788843445.445950:0:18962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795754624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843445.445980:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8daa42696200/0xc6b8ac1b0916699 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09166a0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843445.445991:0:18962:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8daa42696200/0xc6b8ac1b0916699 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b09166a0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843445.446059:0:18962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795754752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788843445.446103:0:18962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843445.446139:0:18962:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7793a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843445.446297:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795754752 00000100:00100000:2.0:1788843445.446303:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795754752 00000100:00100000:2.0:1788843445.446527:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788843445.446537:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:18962:x1875737795754752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788843445.446557:0:18959:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788843445.446577:0:18959:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788843445.446580:0:18959:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788843445.447062:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:18962:x1875737795754752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 525us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843445.447072:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788843445.447564:0:18962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795754752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788843445.447739:0:18962:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788843445.447750:0:18962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8daa42696200/0xc6b8ac1b0916699 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09166a0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843445.447762:0:18962:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8daa42696200/0xc6b8ac1b0916699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09166a0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843445.508519:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843446.549015:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843446.789550:0:18997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788843447.559396:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843448.580753:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843448.644710:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795754880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843448.644823:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843448.645014:0:19653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795754880 00000100:00100000:3.0:1788843448.645026:0:19653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795754880 00000100:00100000:3.0:1788843448.645117:0:19653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843448.645128:0:19653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795754880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843448.645173:0:19653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788843448.645230:0:19653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795754880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843448.645237:0:19653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788843448.645309:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843448.645384:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795754880:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788843449.156797:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843449.156806:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788843449.156810:0:38:0:(import.c:65:import_set_state_nolock()) ffff8dab7772f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788843449.156825:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dab7772f800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1788843449.156853:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab7cd43480 x1875737795755264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843449.156930:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795755136:0@lo:400:kworker.0 00000100:00100000:0.0:1788843449.157031:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843449.157113:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788843449.157120:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:345dfd18-3e4c-44c0-bf46-62bd805326d9:3307:1875737795755008:0@lo:400:kworker.0 00000100:00100000:0.0:1788843449.157154:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843449.157180:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795755648:0@lo:400:kworker.0 00000100:00100000:0.0:1788843449.157207:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843449.157236:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795755264:0@lo:8:kworker.0 00000100:00100000:0.0:1788843449.157261:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843449.157291:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795755392:0@lo:400:kworker.0 00000100:00100000:0.0:1788843449.157317:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843449.157335:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843449.157370:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795755520:0@lo:400:kworker.0 00000100:00100000:0.0:1788843449.157400:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843449.157448:0:19650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795755136 00000100:00100000:0.0:1788843449.157457:0:19650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795755136 00000100:00100000:0.0:1788843449.157509:0:19650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795755264 00000100:00100000:0.0:1788843449.157512:0:19650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795755264 00000100:00100000:0.0:1788843449.157534:0:19650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843449.157545:0:19650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795755136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843449.157617:0:19650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795755136:12345-0@lo:400:kworker.0 Request processed in 74us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843449.157625:0:19650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843449.157646:0:19650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843449.157650:0:19650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875737795755264:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788843449.157679:0:19650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:0.0:1788843449.157713:0:19650:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b8ac1b09166a7 00002000:00100000:0.0:1788843449.157737:0:19650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8dab7395b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113970 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788843449.157742:0:19650:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788843449.157745:0:19650:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788843449.158169:0:19650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788843449.158199:0:19650:0:(import.c:65:import_set_state_nolock()) ffff8dab7395a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843449.158254:0:19650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875737795755264:12345-0@lo:8:kworker.0 Request processed in 601us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843449.158262:0:19650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843449.158290:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795755008 00000100:00100000:0.0:1788843449.158295:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795755008 00000100:00100000:0.0:1788843449.158326:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788843449.158333:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:3307:x1875737795755008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843449.158394:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:3307:x1875737795755008:12345-0@lo:400:kworker.0 Request processed in 61us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843449.158400:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788843449.158771:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795755648 00000100:00100000:2.0:1788843449.158776:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795755648 00000100:00100000:2.0:1788843449.158826:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795755392 00000100:00100000:2.0:1788843449.158830:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795755392 00000100:00100000:2.0:1788843449.158843:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795755520 00000100:00100000:2.0:1788843449.158847:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795755520 00000100:00100000:2.0:1788843449.158862:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843449.158869:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795755648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843449.158928:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795755648:12345-0@lo:400:kworker.0 Request processed in 59us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843449.158935:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843449.158949:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788843449.158955:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795755392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843449.158991:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795755392:12345-0@lo:400:kworker.0 Request processed in 36us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843449.158997:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788843449.159009:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788843449.159015:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795755520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843449.159043:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795755520:12345-0@lo:400:kworker.0 Request processed in 29us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843449.159049:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788843449.159071:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788843449.159113:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7cd40a80 x1875737795755520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843449.159130:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795755520:0@lo:400:kworker.0 00010000:00080000:2.0:1788843449.159144:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7cd40000 x1875737795755392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843449.159152:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795755392:0@lo:400:kworker.0 00010000:00080000:2.0:1788843449.159252:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7cd43480 x1875737795755264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788843474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788843449.159266:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788843449.159275:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788843449.159287:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788843449.159291:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab7772f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788843449.159307:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788843449.159313:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795755264:0@lo:8:kworker.0 00000100:00100000:2.0:1788843449.159447:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:345dfd18-3e4c-44c0-bf46-62bd805326d9:3307:1875737795755008:0@lo:400:kworker.0 00010000:00080000:2.0:1788843449.159470:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7cd41880 x1875737795755648/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843449.159480:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795755648:0@lo:400:kworker.0 00000100:00100000:2.0:1788843449.159494:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795755136:0@lo:400:kworker.0 00000004:00080000:2.0:1788843449.159531:0:18989:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788843449.159788:0:18990:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1788843449.159811:0:18990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43781f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18990:1875737795755904:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788843449.159873:0:18990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843449.159901:0:18990:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51597780 going to sleep for 11 seconds 00000100:00100000:3.0:1788843449.159913:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843449.159921:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795755776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843449.159949:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843449.160030:0:19650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795755904 00000100:00100000:3.0:1788843449.160037:0:19650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795755904 00000100:00100000:3.0:1788843449.160079:0:19650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788843449.160087:0:19650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18990:x1875737795755904:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1788843449.160779:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788843449.161203:0:18989:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 573411860528ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788843449.162995:0:20349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795755776 00000100:00100000:1.0:1788843449.163010:0:20349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795755776 00000100:00100000:1.0:1788843449.163083:0:20349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788843449.163095:0:20349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875737795755776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843449.163141:0:20349:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843449.163256:0:20349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875737795755776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (3305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843449.163265:0:20349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788843449.180082:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab43780700 x1875737795755776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843449.180118:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795755776:0@lo:13:osp-pre-1-0.0 00002000:00080000:0.0:1788843449.202169:0:19650:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788843449.202187:0:19650:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:0.0:1788843449.202194:0:19650:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:65) 00002000:00010000:0.0:1788843449.223569:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843449.225807:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c02dc60/0xc6b8ac1b09166ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.225830:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1788843449.225852:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843449.225860:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c02dc60/0xc6b8ac1b09166ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.225887:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c02dc60/0xc6b8ac1b09166ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.225900:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c02dc60/0xc6b8ac1b09166ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.225908:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c02dc60/0xc6b8ac1b09166ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843449.226792:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843449.227388:0:20134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843449.227399:0:20134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c02dc60/0xc6b8ac1b09166ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.227426:0:20134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42696600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843449.227431:0:20134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c02dc60/0xc6b8ac1b09166ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.227442:0:20134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c02dc60/0xc6b8ac1b09166ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.227466:0:20134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c02dc60/0xc6b8ac1b09166ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.227488:0:20134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c02dc60/0xc6b8ac1b09166ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.227514:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843449.227517:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843449.227519:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.232439:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.232454:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b09166b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.232476:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.232482:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.232489:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b09166b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.232649:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b09166b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.232663:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b09166b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.232673:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b09166b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.232695:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843449.232711:0:20135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843449.232719:0:20135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b09166b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.232729:0:20135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fceec00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843449.232740:0:20135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b09166b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.232751:0:20135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b09166b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.232772:0:20135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b09166b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.232780:0:20135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b09166b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.232802:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.232804:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.232806:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.233852:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.233863:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b09166bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.233878:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.233883:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.234320:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b09166bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.234375:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b09166bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.234387:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b09166bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.234415:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b09166bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.234436:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843449.234462:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843449.234471:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b09166bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.234480:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcefe00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843449.234485:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b09166bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.234494:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b09166bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.234514:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b09166bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.234534:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b09166bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.234556:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.234558:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.234560:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.235421:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.235431:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008042bb26/0xc6b8ac1b09166c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.235444:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.235449:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.235455:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008042bb26/0xc6b8ac1b09166c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.235466:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008042bb26/0xc6b8ac1b09166c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.235477:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008042bb26/0xc6b8ac1b09166c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.235485:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008042bb26/0xc6b8ac1b09166c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.235654:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843449.235686:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843449.235693:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008042bb26/0xc6b8ac1b09166c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.235702:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcef600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843449.235706:0:18954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008042bb26/0xc6b8ac1b09166c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.235715:0:18954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008042bb26/0xc6b8ac1b09166c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.235728:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008042bb26/0xc6b8ac1b09166c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.235735:0:18954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008042bb26/0xc6b8ac1b09166c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.235752:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.235754:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.235755:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.236642:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.236652:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b9d9c68/0xc6b8ac1b09166ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.236671:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.236675:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.236681:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b9d9c68/0xc6b8ac1b09166ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.236694:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b9d9c68/0xc6b8ac1b09166ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.236703:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b9d9c68/0xc6b8ac1b09166ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.236712:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b9d9c68/0xc6b8ac1b09166ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.236739:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843449.236810:0:20134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843449.236826:0:20134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b9d9c68/0xc6b8ac1b09166ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.236835:0:20134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcef400 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843449.236839:0:20134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b9d9c68/0xc6b8ac1b09166ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.236848:0:20134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b9d9c68/0xc6b8ac1b09166ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.236861:0:20134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b9d9c68/0xc6b8ac1b09166ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.236869:0:20134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b9d9c68/0xc6b8ac1b09166ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.236885:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.236887:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.236889:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.237437:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.237444:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000251456e3/0xc6b8ac1b09166d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.237454:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.237458:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.237463:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000251456e3/0xc6b8ac1b09166d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.237473:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000251456e3/0xc6b8ac1b09166d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.237503:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000251456e3/0xc6b8ac1b09166d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.237511:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000251456e3/0xc6b8ac1b09166d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.237527:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843449.237630:0:20135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843449.237636:0:20135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000251456e3/0xc6b8ac1b09166d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.237644:0:20135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcef800 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843449.237648:0:20135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000251456e3/0xc6b8ac1b09166d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.237657:0:20135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000251456e3/0xc6b8ac1b09166d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.237669:0:20135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000251456e3/0xc6b8ac1b09166d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.237676:0:20135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000251456e3/0xc6b8ac1b09166d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.237691:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.237697:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.237699:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.238385:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.238392:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acdf6582/0xc6b8ac1b09166d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.238667:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.238673:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.238679:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acdf6582/0xc6b8ac1b09166d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.238692:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acdf6582/0xc6b8ac1b09166d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.238703:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acdf6582/0xc6b8ac1b09166d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.238711:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acdf6582/0xc6b8ac1b09166d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.238730:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788843449.239694:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.239702:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a3b48ae/0xc6b8ac1b09166df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.239715:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.239719:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.239724:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a3b48ae/0xc6b8ac1b09166df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.239742:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a3b48ae/0xc6b8ac1b09166df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.239752:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a3b48ae/0xc6b8ac1b09166df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.239759:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a3b48ae/0xc6b8ac1b09166df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.239775:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788843449.240191:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843449.240202:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acdf6582/0xc6b8ac1b09166d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.240212:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcef000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843449.240283:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acdf6582/0xc6b8ac1b09166d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.240309:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acdf6582/0xc6b8ac1b09166d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.240680:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acdf6582/0xc6b8ac1b09166d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.240688:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acdf6582/0xc6b8ac1b09166d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.240713:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843449.240717:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a3b48ae/0xc6b8ac1b09166df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.240725:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcefa00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843449.240729:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a3b48ae/0xc6b8ac1b09166df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.240736:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a3b48ae/0xc6b8ac1b09166df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.240746:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a3b48ae/0xc6b8ac1b09166df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.240753:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a3b48ae/0xc6b8ac1b09166df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.240777:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.240778:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.240804:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.240810:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e910d4b/0xc6b8ac1b09166e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.240880:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.240884:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.240889:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e910d4b/0xc6b8ac1b09166e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.240900:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e910d4b/0xc6b8ac1b09166e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.240908:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e910d4b/0xc6b8ac1b09166e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.241054:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e910d4b/0xc6b8ac1b09166e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.241172:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.241181:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.242330:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843449.242365:0:20134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843449.242372:0:20134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e910d4b/0xc6b8ac1b09166e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.242385:0:20134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcee600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843449.242390:0:20134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e910d4b/0xc6b8ac1b09166e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.242402:0:20134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e910d4b/0xc6b8ac1b09166e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.242431:0:20134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e910d4b/0xc6b8ac1b09166e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.242438:0:20134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e910d4b/0xc6b8ac1b09166e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.245817:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.245825:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.245828:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.246801:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.246822:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000716c4041/0xc6b8ac1b09166ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.246842:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.246848:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.246856:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000716c4041/0xc6b8ac1b09166ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.246873:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000716c4041/0xc6b8ac1b09166ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.246884:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000716c4041/0xc6b8ac1b09166ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.246893:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000716c4041/0xc6b8ac1b09166ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.246916:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843449.247080:0:20135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843449.247087:0:20135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000716c4041/0xc6b8ac1b09166ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.247097:0:20135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcee000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843449.247103:0:20135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000716c4041/0xc6b8ac1b09166ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.247168:0:20135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000716c4041/0xc6b8ac1b09166ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.247194:0:20135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000716c4041/0xc6b8ac1b09166ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.247203:0:20135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000716c4041/0xc6b8ac1b09166ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.247223:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.247225:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.247227:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.247702:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.247709:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dee79720/0xc6b8ac1b09166f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.247718:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.247721:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.247726:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dee79720/0xc6b8ac1b09166f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.247737:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dee79720/0xc6b8ac1b09166f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.247746:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dee79720/0xc6b8ac1b09166f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.247755:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dee79720/0xc6b8ac1b09166f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.247784:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788843449.248689:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.248699:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000011f2677/0xc6b8ac1b09166fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.248713:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.248717:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.248722:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000011f2677/0xc6b8ac1b09166fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.248734:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000011f2677/0xc6b8ac1b09166fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.248743:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000011f2677/0xc6b8ac1b09166fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.248752:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000011f2677/0xc6b8ac1b09166fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.248771:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788843449.249830:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.249839:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916702 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.249854:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.249865:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.249871:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916702 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.249884:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916702 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.249893:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916702 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.249901:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916702 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.252749:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788843449.252766:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dee79720/0xc6b8ac1b09166f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.252916:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fceee00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843449.252922:0:18954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dee79720/0xc6b8ac1b09166f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.252937:0:18954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dee79720/0xc6b8ac1b09166f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.252963:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dee79720/0xc6b8ac1b09166f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.252971:0:18954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dee79720/0xc6b8ac1b09166f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.252999:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843449.253003:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000011f2677/0xc6b8ac1b09166fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.253011:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcefc00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843449.253022:0:18954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000011f2677/0xc6b8ac1b09166fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.253031:0:18954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000011f2677/0xc6b8ac1b09166fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.253041:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000011f2677/0xc6b8ac1b09166fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.253049:0:18954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000011f2677/0xc6b8ac1b09166fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.253065:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843449.253069:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916702 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.253076:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcee800 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843449.253080:0:18954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916702 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.253088:0:18954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916702 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.253098:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916702 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.253168:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.253176:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.253178:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.253289:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788843449.253298:0:19650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916702 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.253328:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843449.253493:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.256232:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.256246:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b0916709 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.256268:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.256274:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.256281:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b0916709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.256298:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b0916709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.256317:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b0916709 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.256325:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b0916709 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.256378:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843449.256502:0:20135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843449.256511:0:20135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b0916709 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.256520:0:20135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fceec00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843449.256525:0:20135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b0916709 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.256536:0:20135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b0916709 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.256556:0:20135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b0916709 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.256564:0:20135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b0916709 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788843449.256886:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.256892:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000251456e3/0xc6b8ac1b0916710 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.256902:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.256905:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.256910:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000251456e3/0xc6b8ac1b0916710 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.257049:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000251456e3/0xc6b8ac1b0916710 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.257060:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000251456e3/0xc6b8ac1b0916710 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.257068:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000251456e3/0xc6b8ac1b0916710 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.257095:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843449.257114:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843449.257122:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000251456e3/0xc6b8ac1b0916710 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.257130:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcef800 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843449.257134:0:18954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000251456e3/0xc6b8ac1b0916710 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.257142:0:18954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000251456e3/0xc6b8ac1b0916710 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.257154:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000251456e3/0xc6b8ac1b0916710 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.257162:0:18954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000251456e3/0xc6b8ac1b0916710 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.257181:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.257183:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.257185:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.257681:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.257689:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b0916717 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.257697:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.257701:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.257705:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b0916717 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.257715:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b0916717 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.257724:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b0916717 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.257732:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b0916717 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.257746:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843449.257755:0:20134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843449.257760:0:20134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b0916717 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.257768:0:20134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcefe00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843449.257778:0:20134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b0916717 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.257786:0:20134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b0916717 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.257798:0:20134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b0916717 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.257805:0:20134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b0916717 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.257820:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.257822:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.257824:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843449.258018:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843449.258021:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843449.258023:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.258559:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.258567:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b37969a/0xc6b8ac1b091671e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.258578:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.258583:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.258587:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b37969a/0xc6b8ac1b091671e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.258597:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b37969a/0xc6b8ac1b091671e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.258606:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b37969a/0xc6b8ac1b091671e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.258620:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b37969a/0xc6b8ac1b091671e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.258643:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843449.258911:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843449.258918:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b37969a/0xc6b8ac1b091671e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.258927:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcef200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843449.258932:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b37969a/0xc6b8ac1b091671e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.258948:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b37969a/0xc6b8ac1b091671e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.258962:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b37969a/0xc6b8ac1b091671e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.258970:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b37969a/0xc6b8ac1b091671e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.258987:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.258989:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.258991:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.259252:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.259258:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916725 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.259268:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.259272:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.259276:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916725 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.259286:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916725 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.259295:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916725 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.259303:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.259314:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788843449.259821:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.259828:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000babd2ba4/0xc6b8ac1b091672c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.259843:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.259847:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.259851:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000babd2ba4/0xc6b8ac1b091672c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.259862:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000babd2ba4/0xc6b8ac1b091672c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.259868:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843449.259871:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000babd2ba4/0xc6b8ac1b091672c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.259875:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.259878:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000babd2ba4/0xc6b8ac1b091672c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.259884:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcee200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843449.259887:0:18954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.259893:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843449.259896:0:18954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916725 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.259901:0:20134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843449.259905:0:20134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000babd2ba4/0xc6b8ac1b091672c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.259908:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916725 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.259912:0:20134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcee400 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843449.259916:0:20134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000babd2ba4/0xc6b8ac1b091672c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.259926:0:18954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916725 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.259944:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.259946:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.259948:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.260043:0:20134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000babd2ba4/0xc6b8ac1b091672c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.260065:0:20134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000babd2ba4/0xc6b8ac1b091672c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.260072:0:20134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000babd2ba4/0xc6b8ac1b091672c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.260086:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.260087:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.260089:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.279469:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.279491:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916733 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.279525:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.279530:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.279538:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916733 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.279554:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916733 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.279567:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916733 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.280745:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916733 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.281093:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843449.281321:0:20135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843449.281329:0:20135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916733 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.281365:0:20135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcee800 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843449.281371:0:20135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916733 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.281384:0:20135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916733 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.281415:0:20135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916733 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.281423:0:20135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916733 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.281452:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.281454:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.281456:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.285885:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.285907:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b091673a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.285939:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.285954:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.285961:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b091673a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788843449.286294:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788843449.286741:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b091673a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.286766:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b091673a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.286777:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b091673a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.286816:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843449.286917:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843449.286926:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b091673a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.286936:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcefe00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843449.286941:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b091673a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.286951:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b091673a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.286973:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b091673a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.286981:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cea536fa/0xc6b8ac1b091673a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.287005:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843449.287007:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843449.287008:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.288282:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.288294:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000716c4041/0xc6b8ac1b0916741 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.288311:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.288316:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.288323:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000716c4041/0xc6b8ac1b0916741 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.288336:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000716c4041/0xc6b8ac1b0916741 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.288373:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000716c4041/0xc6b8ac1b0916741 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.288389:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000716c4041/0xc6b8ac1b0916741 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.288421:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843449.288463:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843449.288472:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000716c4041/0xc6b8ac1b0916741 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.288481:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcee000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843449.288486:0:18954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000716c4041/0xc6b8ac1b0916741 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.288496:0:18954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000716c4041/0xc6b8ac1b0916741 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.288512:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000716c4041/0xc6b8ac1b0916741 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.288519:0:18954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000716c4041/0xc6b8ac1b0916741 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.288540:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.288542:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.288544:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.289186:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.289193:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e910d4b/0xc6b8ac1b0916748 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.289204:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.289208:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.289213:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e910d4b/0xc6b8ac1b0916748 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.289223:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e910d4b/0xc6b8ac1b0916748 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.289231:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e910d4b/0xc6b8ac1b0916748 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.289238:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e910d4b/0xc6b8ac1b0916748 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.289265:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843449.289304:0:20134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843449.289322:0:20134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e910d4b/0xc6b8ac1b0916748 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.289331:0:20134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcee600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843449.289335:0:20134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e910d4b/0xc6b8ac1b0916748 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.289376:0:20134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e910d4b/0xc6b8ac1b0916748 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.289389:0:20134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e910d4b/0xc6b8ac1b0916748 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.289396:0:20134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e910d4b/0xc6b8ac1b0916748 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.289424:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843449.289426:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843449.289428:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.290528:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.290537:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000babd2ba4/0xc6b8ac1b091674f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.290556:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.290560:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.290566:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000babd2ba4/0xc6b8ac1b091674f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.290892:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000babd2ba4/0xc6b8ac1b091674f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.290903:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000babd2ba4/0xc6b8ac1b091674f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.290911:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000babd2ba4/0xc6b8ac1b091674f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.291055:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843449.291325:0:20135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843449.291332:0:20135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000babd2ba4/0xc6b8ac1b091674f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.291375:0:20135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcee400 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843449.291379:0:20135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000babd2ba4/0xc6b8ac1b091674f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.291389:0:20135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000babd2ba4/0xc6b8ac1b091674f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.291414:0:20135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000babd2ba4/0xc6b8ac1b091674f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.291435:0:20135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000babd2ba4/0xc6b8ac1b091674f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.291459:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843449.291461:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843449.291463:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.297470:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.297505:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000776d1d16/0xc6b8ac1b0916756 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.297528:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.297534:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.297541:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000776d1d16/0xc6b8ac1b0916756 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.297558:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000776d1d16/0xc6b8ac1b0916756 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.298450:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000776d1d16/0xc6b8ac1b0916756 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.298460:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000776d1d16/0xc6b8ac1b0916756 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.298523:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843449.298533:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000776d1d16/0xc6b8ac1b0916756 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.298543:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fceea00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843449.298549:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000776d1d16/0xc6b8ac1b0916756 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.298559:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000776d1d16/0xc6b8ac1b0916756 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.298581:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000776d1d16/0xc6b8ac1b0916756 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.298594:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843449.298596:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843449.298598:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.298818:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843449.298880:0:19650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000776d1d16/0xc6b8ac1b0916756 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788843449.301184:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.301199:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b091675d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.301220:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.301225:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.301232:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b091675d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.301249:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b091675d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.301260:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b091675d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.301282:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b091675d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.301312:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788843449.302104:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.302116:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916764 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.302129:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.302133:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.302140:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916764 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.302152:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916764 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.302162:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916764 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.302169:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916764 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.302191:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788843449.302200:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843449.302202:0:20134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843449.302209:0:20134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916764 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.302210:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b091675d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.302223:0:20134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcee200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843449.302228:0:20134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916764 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.302238:0:20134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916764 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.302257:0:20134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916764 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.302265:0:20134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060bc8a69/0xc6b8ac1b0916764 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.302287:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.302289:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.302291:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.302434:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fceec00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843449.302438:0:18954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b091675d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.302447:0:18954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b091675d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.302458:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b091675d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.302465:0:18954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061712246/0xc6b8ac1b091675d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.302479:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.302481:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843449.302483:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.303102:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.303112:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b37969a/0xc6b8ac1b091676b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.303123:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.303132:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.303138:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b37969a/0xc6b8ac1b091676b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.303148:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b37969a/0xc6b8ac1b091676b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.303164:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b37969a/0xc6b8ac1b091676b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.303171:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b37969a/0xc6b8ac1b091676b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.303196:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843449.303329:0:20135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843449.303337:0:20135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b37969a/0xc6b8ac1b091676b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.303422:0:20135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcef200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843449.303426:0:20135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b37969a/0xc6b8ac1b091676b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.303434:0:20135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b37969a/0xc6b8ac1b091676b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.303448:0:20135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b37969a/0xc6b8ac1b091676b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.303456:0:20135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b37969a/0xc6b8ac1b091676b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.303471:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843449.303473:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843449.303474:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843449.303747:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843449.303752:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916772 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.303761:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=573s v=(0 0) 00010000:00010000:1.0:1788843449.303765:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843449.303768:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916772 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.303777:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916772 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.303785:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916772 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.303792:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916772 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.303884:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843449.303888:0:18953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843449.303894:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916772 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.303902:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcee800 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843449.303906:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916772 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.303914:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916772 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.303932:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916772 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.303939:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afb2c055/0xc6b8ac1b0916772 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.303952:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843449.303954:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843449.303956:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843449.304518:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843449.304526:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c02dc60/0xc6b8ac1b0916779 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.304537:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1788843449.304540:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843449.304545:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c02dc60/0xc6b8ac1b0916779 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.304556:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c02dc60/0xc6b8ac1b0916779 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.304565:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c02dc60/0xc6b8ac1b0916779 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.304573:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c02dc60/0xc6b8ac1b0916779 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.304646:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843449.304683:0:20134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843449.304689:0:20134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c02dc60/0xc6b8ac1b0916779 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.304699:0:20134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42696600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843449.304703:0:20134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c02dc60/0xc6b8ac1b0916779 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.304712:0:20134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c02dc60/0xc6b8ac1b0916779 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.304724:0:20134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c02dc60/0xc6b8ac1b0916779 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.304731:0:20134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c02dc60/0xc6b8ac1b0916779 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.304748:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.304749:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.304751:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843449.307073:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843449.307089:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2e65063/0xc6b8ac1b0916780 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.307110:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1788843449.307115:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843449.307122:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e65063/0xc6b8ac1b0916780 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.307710:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2e65063/0xc6b8ac1b0916780 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.307730:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2e65063/0xc6b8ac1b0916780 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.307740:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e65063/0xc6b8ac1b0916780 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.308032:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788843449.308731:0:19650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843449.308739:0:19650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000645dc08e/0xc6b8ac1b0916787 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.308755:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1788843449.308765:0:19650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843449.308771:0:19650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000645dc08e/0xc6b8ac1b0916787 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.308797:0:19650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000645dc08e/0xc6b8ac1b0916787 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.308808:0:19650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000645dc08e/0xc6b8ac1b0916787 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843449.308824:0:19650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000645dc08e/0xc6b8ac1b0916787 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.310310:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843449.310334:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2e65063/0xc6b8ac1b0916780 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.310369:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42697200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843449.310375:0:18954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e65063/0xc6b8ac1b0916780 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.310414:0:18954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e65063/0xc6b8ac1b0916780 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.310440:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2e65063/0xc6b8ac1b0916780 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843449.310449:0:18954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2e65063/0xc6b8ac1b0916780 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.310939:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843449.310947:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000645dc08e/0xc6b8ac1b0916787 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.310955:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42697800 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843449.310967:0:18954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000645dc08e/0xc6b8ac1b0916787 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.310977:0:18954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000645dc08e/0xc6b8ac1b0916787 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.310990:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000645dc08e/0xc6b8ac1b0916787 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843449.310998:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.311000:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843449.311002:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843449.314593:0:19650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788843449.314614:0:19650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000645dc08e/0xc6b8ac1b0916787 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788843449.316750:0:19650:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1788843449.317134:0:19650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18990:x1875737795755904:12345-0@lo:5:osp-pre-1-0.0 Request processed in 157040us (157253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843449.317149:0:19650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788843449.319847:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843449.322388:0:18990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43781f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18990:1875737795755904:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788843449.322603:0:18990:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788843449.327038:0:18990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18990:1875737795756032:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788843449.327164:0:18990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843449.327329:0:18990:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab71b0f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788843449.331942:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795756032 00000100:00100000:2.0:1788843449.331961:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795756032 00000100:00100000:2.0:1788843449.332124:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788843449.332146:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:18990:x1875737795756032:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788843449.332213:0:19651:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:2.0:1788843449.350731:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:18990:x1875737795756032:12345-0@lo:5:osp-pre-1-0.0 Request processed in 18585us (23587us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788843449.350747:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788843449.351460:0:18990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18990:1875737795756032:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788843449.351482:0:18990:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00010000:00010000:0.0:1788843449.604746:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788843449.753279:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788843449.753392:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00010000:00010000:1.0:1788843450.628645:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843451.652592:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788843451.908826:0:20729:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788843452.678137:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843453.700538:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843453.768580:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795756160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843453.768686:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843453.768803:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795756160 00000100:00100000:1.0:1788843453.768815:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795756160 00000100:00100000:1.0:1788843453.768898:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843453.768910:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795756160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843453.768958:0:19654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788843453.771748:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795756160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2831us (3052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843453.771768:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788843453.771821:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843453.774408:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795756160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843454.280719:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795756288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843454.280790:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843454.281481:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795756544:0@lo:400:kworker.0 00000100:00100000:2.0:1788843454.281521:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843454.281555:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843454.281562:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:345dfd18-3e4c-44c0-bf46-62bd805326d9:3307:1875737795756416:0@lo:400:kworker.0 00000100:00100000:3.0:1788843454.281587:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795756544 00000100:00100000:3.0:1788843454.281596:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795756544 00000100:00100000:2.0:1788843454.281601:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843454.281642:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795756416 00000100:00100000:2.0:1788843454.281646:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795756416 00000100:00100000:3.0:1788843454.281653:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788843454.281665:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795756544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843454.281682:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788843454.281691:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:3307:x1875737795756416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843454.281737:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795756544:12345-0@lo:400:kworker.0 Request processed in 75us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843454.281741:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:3307:x1875737795756416:12345-0@lo:400:kworker.0 Request processed in 50us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843454.281751:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788843454.281754:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788843454.281811:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:345dfd18-3e4c-44c0-bf46-62bd805326d9:3307:1875737795756416:0@lo:400:kworker.0 00010000:00080000:2.0:1788843454.281823:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab73a79180 x1875737795756544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843454.281834:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795756544:0@lo:400:kworker.0 00000100:00100000:2.0:1788843454.282433:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795756800:0@lo:400:kworker.0 00000100:00100000:2.0:1788843454.282469:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843454.282499:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843454.282506:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795756672:0@lo:400:kworker.0 00000100:00100000:2.0:1788843454.282531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843454.282568:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795756800 00000100:00100000:2.0:1788843454.282573:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795756800 00000100:00100000:2.0:1788843454.282618:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795756672 00000100:00100000:2.0:1788843454.282621:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795756672 00000100:00100000:2.0:1788843454.282638:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788843454.282646:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875737795756800:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788843454.282671:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843454.282689:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875737795756800:12345-0@lo:400:kworker.0 Request processed in 43us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843454.282705:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788843454.282719:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843454.282725:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795756672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843454.282750:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795756672:12345-0@lo:400:kworker.0 Request processed in 26us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843454.282756:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788843454.282848:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab73a7aa00 x1875737795756672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843454.282859:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795756672:0@lo:400:kworker.0 00010000:00080000:2.0:1788843454.282869:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab73a79180 x1875737795756800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843454.282877:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795756800:0@lo:400:kworker.0 00000100:00100000:0.0:1788843454.284116:0:19653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795756288 00000100:00100000:0.0:1788843454.284127:0:19653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795756288 00000100:00100000:0.0:1788843454.284194:0:19653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788843454.284204:0:19653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795756288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843454.284238:0:19653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788843454.284276:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788843454.284303:0:19653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795756288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (3513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843454.284311:0:19653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788843454.284379:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788843454.284399:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795756288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843454.408397:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843454.408577:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775836672 00000100:00100000:0.0:1788843454.408586:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775836672 00000100:00100000:0.0:1788843454.408628:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 77 00000100:00100000:0.0:1788843454.408635:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2355:x1875737775836672:12345-192.168.203.29@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788843454.408662:0:18960:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e27f4f77-381a-4316-945d-346e72200308@192.168.203.29@tcp t0 exp 0000000000000000 cur 578 last 0 00000020:00000080:0.0:1788843454.408697:0:18960:0:(genops.c:1385:class_connect()) connect: client e27f4f77-381a-4316-945d-346e72200308, cookie 0xc6b8ac1b091678e 00000100:00080000:0.0:1788843454.408825:0:18960:0:(import.c:65:import_set_state_nolock()) ffff8dab7395f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843454.408920:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+5:2355:x1875737775836672:12345-192.168.203.29@tcp:250:mount.lustre.0 Request processed in 283us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843454.408928:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 77 00000100:00100000:0.0:1788843454.414983:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843454.415049:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775836800 00000100:00100000:2.0:1788843454.415059:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775836800 00000100:00100000:2.0:1788843454.415149:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 78 00000100:00100000:2.0:1788843454.415159:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+5:16740:x1875737775836800:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788843454.415173:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843454.415190:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0916795 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084d9d expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843454.415216:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0916795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d9d expref: 6 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843454.415227:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0916795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d9d expref: 6 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843454.415253:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88c00, rc 0) 00000100:00100000:2.0:1788843454.415314:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+6:16740:x1875737775836800:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 156us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843454.415321:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 78 00000100:00100000:3.0:1788843454.422416:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843454.423828:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775836928 00000100:00100000:2.0:1788843454.423843:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775836928 00000100:00100000:2.0:1788843454.423916:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 79 00000100:00100000:2.0:1788843454.423927:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+6:16740:x1875737775836928:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788843454.424206:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+6:16740:x1875737775836928:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 280us (1804us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788843454.424215:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 79 00000100:00100000:3.0:1788843454.437712:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843454.438575:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775837056 00000100:00100000:2.0:1788843454.438591:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775837056 00000100:00100000:2.0:1788843454.438675:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 80 00000100:00100000:2.0:1788843454.438690:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+6:16740:x1875737775837056:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788843454.438715:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843454.438742:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7ff89400/0xc6b8ac1b091679c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084da4 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843454.439012:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff89400/0xc6b8ac1b091679c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084da4 expref: 7 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843454.439030:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7ff89400/0xc6b8ac1b091679c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084da4 expref: 7 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843454.439041:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89400, rc 0) 00000100:00100000:2.0:1788843454.439185:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+7:16740:x1875737775837056:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 499us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843454.439194:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 80 00000100:00100000:3.0:1788843454.447168:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843454.447289:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775837184 00000100:00100000:0.0:1788843454.447303:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775837184 00000100:00100000:0.0:1788843454.447590:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00100000:0.0:1788843454.447603:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+7:16740:x1875737775837184:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788843454.447911:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+8:16740:x1875737775837184:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 310us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843454.447920:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00100000:1.0:1788843454.451636:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843454.459582:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775837312 00000100:00100000:2.0:1788843454.459595:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775837312 00000100:00100000:2.0:1788843454.459649:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 82 00000100:00100000:2.0:1788843454.459659:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+8:16740:x1875737775837312:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788843454.459875:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+8:16740:x1875737775837312:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 216us (8248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843454.459883:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 82 00000100:00100000:3.0:1788843454.466595:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843454.466894:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775837440 00000100:00100000:2.0:1788843454.466903:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775837440 00000100:00100000:2.0:1788843454.466959:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 83 00000100:00100000:2.0:1788843454.466970:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+8:16759:x1875737775837440:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788843454.467468:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+8:16759:x1875737775837440:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 499us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843454.467477:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 83 00000100:00100000:1.0:1788843454.499251:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843454.499419:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775837568 00000100:00100000:3.0:1788843454.499433:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775837568 00000100:00100000:0.0:1788843454.500113:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 84 00000100:00100000:0.0:1788843454.500132:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+8:16759:x1875737775837568:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788843454.500568:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+8:16759:x1875737775837568:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 441us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843454.500580:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 84 00000100:00100000:3.0:1788843454.512989:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843454.513646:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775837696 00000100:00100000:0.0:1788843454.513661:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775837696 00000100:00100000:0.0:1788843454.513738:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 85 00000100:00100000:0.0:1788843454.513751:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+8:16740:x1875737775837696:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788843454.513773:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843454.513806:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8daa42697800/0xc6b8ac1b09167a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084dce expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843454.513844:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8daa42697800/0xc6b8ac1b09167a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084dce expref: 9 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843454.513880:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8daa42697800/0xc6b8ac1b09167a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084dce expref: 9 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843454.513891:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8daa42697800, rc 0) 00000100:00100000:0.0:1788843454.514053:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+9:16740:x1875737775837696:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 304us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843454.514061:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 85 00000100:00100000:3.0:1788843454.518854:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843454.519062:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775837824 00000100:00100000:0.0:1788843454.519075:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775837824 00000100:00100000:0.0:1788843454.519155:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 86 00000100:00100000:0.0:1788843454.519168:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+9:16740:x1875737775837824:12345-192.168.203.29@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788843454.519202:0:18958:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788843454.519236:0:18958:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788843454.519240:0:18958:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788843454.519244:0:18958:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788843454.519246:0:18958:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:0.0:1788843454.521473:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+9:16740:x1875737775837824:12345-192.168.203.29@tcp:256:mount.lustre.0 Request processed in 2295us (2621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843454.521490:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 86 00000100:00100000:3.0:1788843454.524851:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843454.525127:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775837952 00000100:00100000:2.0:1788843454.525139:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775837952 00000100:00100000:2.0:1788843454.525205:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 87 00000100:00100000:2.0:1788843454.525214:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+9:16740:x1875737775837952:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788843454.525234:0:18959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843454.525253:0:18959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7ff88200/0xc6b8ac1b09167aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084dd5 expref: -99 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843454.525289:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff88200/0xc6b8ac1b09167aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084dd5 expref: 10 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843454.525322:0:18959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7ff88200/0xc6b8ac1b09167aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084dd5 expref: 10 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843454.525334:0:18959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88200, rc 0) 00000100:00100000:2.0:1788843454.525442:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+10:16740:x1875737775837952:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 229us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843454.525449:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 87 00000100:00100000:3.0:1788843454.526916:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843454.527249:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775838080 00000100:00100000:0.0:1788843454.527261:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775838080 00000100:00100000:0.0:1788843454.527321:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 88 00000100:00100000:0.0:1788843454.527332:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+10:16740:x1875737775838080:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788843454.527766:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+10:16740:x1875737775838080:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 433us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843454.527849:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 88 00000100:00100000:1.0:1788843454.530298:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843454.530451:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775838208 00000100:00100000:0.0:1788843454.530464:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775838208 00000100:00100000:0.0:1788843454.530535:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 89 00000100:00100000:0.0:1788843454.530546:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+10:16740:x1875737775838208:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788843454.531265:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+10:16740:x1875737775838208:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 715us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843454.531275:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 89 00000100:00100000:3.0:1788843454.534503:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843454.534766:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775838336 00000100:00100000:2.0:1788843454.534788:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775838336 00000100:00100000:2.0:1788843454.534865:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 90 00000100:00100000:2.0:1788843454.534877:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+10:16765:x1875737775838336:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788843454.535211:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+10:16765:x1875737775838336:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 335us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843454.535220:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 90 00000100:00100000:3.0:1788843454.542130:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843454.547527:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775838464 00000100:00100000:0.0:1788843454.547549:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775838464 00000100:00100000:0.0:1788843454.547652:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 91 00000100:00100000:0.0:1788843454.547665:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+10:16765:x1875737775838464:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788843454.548040:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+10:16765:x1875737775838464:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 375us (5922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843454.548050:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 91 00000100:00100000:1.0:1788843454.563471:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843454.563587:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775838592 00000100:00100000:2.0:1788843454.563601:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775838592 00000100:00100000:2.0:1788843454.563663:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:2.0:1788843454.563674:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2355:x1875737775838592:12345-192.168.203.29@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788843454.563714:0:18967:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f626edf3-537d-4eb9-9825-d3d39a257fe8@192.168.203.29@tcp t0 exp 0000000000000000 cur 578 last 0 00000020:00000080:2.0:1788843454.563777:0:18967:0:(genops.c:1385:class_connect()) connect: client f626edf3-537d-4eb9-9825-d3d39a257fe8, cookie 0xc6b8ac1b09167b1 00000004:00100000:2.0:1788843454.563824:0:18967:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788843454.563831:0:18967:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:0.0:1788843454.610982:0:18967:0:(import.c:65:import_set_state_nolock()) ffff8dab7395b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843454.611100:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+6:2355:x1875737775838592:12345-192.168.203.29@tcp:38:mount.lustre.0 Request processed in 47425us (47644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843454.611113:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:3.0:1788843454.614711:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843454.615329:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843454.616389:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775838720 00000100:00100000:2.0:1788843454.616408:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775838720 00000100:00080000:3.0:1788843454.616709:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843454.616800:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775838848 00000100:00100000:2.0:1788843454.616819:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775838848 00000100:00100000:2.0:1788843454.616848:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:2.0:1788843454.616860:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+7:0:x1875737775838720:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788843454.616943:0:18965:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788843454.617069:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+7:0:x1875737775838720:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 210us (2372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843454.617077:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:2.0:1788843454.617098:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:2.0:1788843454.617105:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+6:16740:x1875737775838848:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788843454.617117:0:18965:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788843454.617142:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+6:16740:x1875737775838848:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 38us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843454.617148:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:3.0:1788843454.620200:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843454.620612:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775838976 00000100:00100000:2.0:1788843454.620626:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775838976 00000100:00100000:2.0:1788843454.620690:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1788843454.620703:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+6:16740:x1875737775838976:12345-192.168.203.29@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788843454.621514:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+6:16740:x1875737775838976:12345-192.168.203.29@tcp:40:mount.lustre.0 Request processed in 805us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843454.621525:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:1.0:1788843454.624784:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843454.624951:0:20132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775839104 00000100:00100000:2.0:1788843454.624963:0:20132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775839104 00000100:00100000:2.0:1788843454.625022:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:2.0:1788843454.625033:0:20132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2355:x1875737775839104:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788843454.625078:0:20132:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f626edf3-537d-4eb9-9825-d3d39a257fe8@192.168.203.29@tcp t0 exp 0000000000000000 cur 578 last 0 00000020:00000080:2.0:1788843454.625142:0:20132:0:(genops.c:1385:class_connect()) connect: client f626edf3-537d-4eb9-9825-d3d39a257fe8, cookie 0xc6b8ac1b09167b8 00002000:00100000:2.0:1788843454.625159:0:20132:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f626edf3-537d-4eb9-9825-d3d39a257fe8/ffff8daa42062000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1788843454.625175:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00002000:00100000:2.0:1788843454.625175:0:20132:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788843454.625398:0:19652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775839232 00000100:00100000:1.0:1788843454.625403:0:19652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775839232 00000100:00100000:1.0:1788843454.625431:0:19652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:1.0:1788843454.625438:0:19652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1875737775839232:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788843454.625456:0:19652:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f626edf3-537d-4eb9-9825-d3d39a257fe8@192.168.203.29@tcp t0 exp 0000000000000000 cur 578 last 0 00000020:00000080:1.0:1788843454.625491:0:19652:0:(genops.c:1385:class_connect()) connect: client f626edf3-537d-4eb9-9825-d3d39a257fe8, cookie 0xc6b8ac1b09167bf 00002000:00100000:1.0:1788843454.625497:0:19652:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f626edf3-537d-4eb9-9825-d3d39a257fe8/ffff8daa411b3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788843454.625504:0:19652:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788843454.625848:0:19652:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788843454.625887:0:19652:0:(import.c:65:import_set_state_nolock()) ffff8daa411b0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843454.625980:0:19652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+6:2355:x1875737775839232:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 540us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843454.625990:0:19652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00002000:00080000:2.0:1788843454.627197:0:20132:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788843454.627236:0:20132:0:(import.c:65:import_set_state_nolock()) ffff8daa42065800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843454.627298:0:20132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f626edf3-537d-4eb9-9825-d3d39a257fe8+6:2355:x1875737775839104:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 2265us (2537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843454.627308:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:1.0:1788843454.631398:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843454.632044:0:18968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775839360 00000100:00100000:2.0:1788843454.632059:0:18968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775839360 00000100:00100000:2.0:1788843454.632128:0:18968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:2.0:1788843454.632141:0:18968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+6:16740:x1875737775839360:12345-192.168.203.29@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788843454.637980:0:18968:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5743us 00000004:00200000:1.0:1788843454.651947:0:18968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788843454.652128:0:18968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+6:16740:x1875737775839360:12345-192.168.203.29@tcp:33:mount.lustre.0 Request processed in 19981us (20786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843454.652144:0:18968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00010000:00010000:1.0:1788843454.725194:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788843454.848438:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f626edf3-537d-4eb9-9825-d3d39a257fe8 00000100:00100000:3.0:1788843454.879412:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843454.879588:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775839488 00000100:00100000:2.0:1788843454.879602:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775839488 00000100:00100000:2.0:1788843454.879719:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:2.0:1788843454.879732:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+6:16786:x1875737775839488:12345-192.168.203.29@tcp:101:mkdir.0 00010000:00010000:2.0:1788843454.879761:0:18965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843454.879801:0:18965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88400/0xc6b8ac1b09167c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084dff expref: -99 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843454.879888:0:18965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b09167cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843454.879904:0:18965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b09167cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843454.879949:0:18965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b09167cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843454.879997:0:18965:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788843454.880001:0:18965:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843454.880227:0:18965:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b09167cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843454.880262:0:18965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88400/0xc6b8ac1b09167c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084dff expref: 8 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843454.880285:0:18965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b09167cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084dff expref: 7 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843454.880294:0:18965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910200) 00010000:00010000:2.0:1788843454.880297:0:18965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843454.880301:0:18965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88000, rc 0) 00000100:00100000:2.0:1788843454.880441:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+7:16786:x1875737775839488:12345-192.168.203.29@tcp:101:mkdir.0 Request processed in 711us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843454.880449:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000001:00100000:0.0:1788843454.883222:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f626edf3-537d-4eb9-9825-d3d39a257fe8 00010000:00010000:2.0:1788843455.749725:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788843456.005568:0:18997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788843456.744486:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843456.744732:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775839616 00000100:00100000:0.0:1788843456.744747:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775839616 00000100:00100000:0.0:1788843456.744842:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:0.0:1788843456.744855:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+7:16839:x1875737775839616:12345-192.168.203.29@tcp:41:lfs.0 00000004:00000024:0.0:1788843456.744914:0:18966:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788843456.745013:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+7:16839:x1875737775839616:12345-192.168.203.29@tcp:41:lfs.0 Request processed in 161us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843456.745021:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00080000:3.0:1788843456.748528:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843456.749677:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843456.755202:0:20349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775839744 00000100:00100000:1.0:1788843456.755225:0:20349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775839744 00000100:00080000:3.0:1788843456.755464:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843456.755508:0:20349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:1.0:1788843456.755523:0:20349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f626edf3-537d-4eb9-9825-d3d39a257fe8+5:16839:x1875737775839744:12345-192.168.203.29@tcp:13:lfs.0 00002000:00000024:1.0:1788843456.755577:0:20349:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788843456.755751:0:20349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f626edf3-537d-4eb9-9825-d3d39a257fe8+5:16839:x1875737775839744:12345-192.168.203.29@tcp:13:lfs.0 Request processed in 223us (6077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843456.755759:0:20349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:2.0:1788843456.767584:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843456.768530:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775839872 00000100:00100000:1.0:1788843456.768548:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775839872 00000100:00100000:1.0:1788843456.768660:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:1.0:1788843456.768674:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f626edf3-537d-4eb9-9825-d3d39a257fe8+5:16839:x1875737775839872:12345-192.168.203.29@tcp:13:lfs.0 00002000:00000024:1.0:1788843456.768726:0:19654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843456.768987:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f626edf3-537d-4eb9-9825-d3d39a257fe8+5:16839:x1875737775839872:12345-192.168.203.29@tcp:13:lfs.0 Request processed in 316us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843456.768997:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00080000:3.0:1788843456.769401:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788843456.772723:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843456.976516:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843456.976615:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775840000 00000100:00100000:0.0:1788843456.976627:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775840000 00000100:00100000:0.0:1788843456.976702:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 92 00000100:00100000:0.0:1788843456.976715:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+10:16870:x1875737775840000:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788843456.976743:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843456.976770:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8daa42696e00/0xc6b8ac1b09167d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084e06 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.976808:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8daa42696e00/0xc6b8ac1b09167d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e06 expref: 11 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.976820:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8daa42696e00/0xc6b8ac1b09167d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e06 expref: 11 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.976830:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8daa42696e00, rc 0) 00000100:00100000:0.0:1788843456.976908:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+11:16870:x1875737775840000:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 196us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843456.976916:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 92 00000100:00100000:0.0:1788843456.986287:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843456.986434:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775840128 00000100:00100000:2.0:1788843456.986448:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775840128 00000100:00100000:2.0:1788843456.986520:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 93 00000100:00100000:2.0:1788843456.986532:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+11:16870:x1875737775840128:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788843456.988204:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+11:16870:x1875737775840128:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 1660us (1919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843456.988220:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 93 00000100:00100000:3.0:1788843456.991014:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843456.993765:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775840256 00000100:00100000:2.0:1788843456.993788:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775840256 00000100:00100000:2.0:1788843456.993886:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 94 00000100:00100000:2.0:1788843456.993898:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fcd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+11:16870:x1875737775840256:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788843456.994388:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fcd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+11:16870:x1875737775840256:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 489us (3385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843456.994397:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 94 00000100:00100000:1.0:1788843457.007231:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843457.008200:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775840384 00000100:00100000:2.0:1788843457.008216:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775840384 00000100:00100000:2.0:1788843457.008400:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 95 00000100:00100000:2.0:1788843457.008414:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+11:16878:x1875737775840384:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788843457.008906:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+11:16878:x1875737775840384:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 493us (1688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.008928:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 95 00000100:00100000:1.0:1788843457.051394:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843457.052053:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775840512 00000100:00100000:2.0:1788843457.052067:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775840512 00000100:00100000:2.0:1788843457.052209:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 96 00000100:00100000:2.0:1788843457.052222:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+11:16878:x1875737775840512:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788843457.052665:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+11:16878:x1875737775840512:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 443us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.052680:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 96 00000100:00100000:3.0:1788843457.055300:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843457.055855:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775840640 00000100:00100000:2.0:1788843457.055869:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775840640 00000100:00100000:2.0:1788843457.055949:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 97 00000100:00100000:2.0:1788843457.055961:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+11:16870:x1875737775840640:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788843457.055984:0:18959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843457.056009:0:18959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7ff88400/0xc6b8ac1b09167db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084e30 expref: -99 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843457.056049:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff88400/0xc6b8ac1b09167db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e30 expref: 12 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843457.056062:0:18959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7ff88400/0xc6b8ac1b09167db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e30 expref: 12 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843457.056072:0:18959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88400, rc 0) 00000100:00100000:2.0:1788843457.056151:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+12:16870:x1875737775840640:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 192us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.056158:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 97 00000100:00100000:1.0:1788843457.060486:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843457.060655:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775840768 00000100:00100000:2.0:1788843457.060668:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775840768 00000100:00100000:2.0:1788843457.060751:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 98 00000100:00100000:2.0:1788843457.060762:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+12:16870:x1875737775840768:12345-192.168.203.29@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788843457.060807:0:18960:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788843457.060837:0:18960:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788843457.061064:0:18960:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788843457.061069:0:18960:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788843457.061071:0:18960:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:2.0:1788843457.065804:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+12:16870:x1875737775840768:12345-192.168.203.29@tcp:256:mount.lustre.0 Request processed in 5028us (5316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.065837:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 98 00000100:00100000:3.0:1788843457.069428:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843457.069526:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775840896 00000100:00100000:0.0:1788843457.069539:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775840896 00000100:00100000:0.0:1788843457.069624:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 99 00000100:00100000:0.0:1788843457.069656:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+12:16870:x1875737775840896:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788843457.070121:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843457.070147:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8daa42696c00/0xc6b8ac1b09167e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084e37 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843457.070188:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8daa42696c00/0xc6b8ac1b09167e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e37 expref: 13 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843457.070201:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8daa42696c00/0xc6b8ac1b09167e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e37 expref: 13 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843457.070211:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8daa42696c00, rc 0) 00000100:00100000:0.0:1788843457.070291:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+13:16870:x1875737775840896:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 637us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843457.070300:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 99 00000100:00100000:1.0:1788843457.073322:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843457.073479:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775841024 00000100:00100000:2.0:1788843457.073491:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775841024 00000100:00100000:2.0:1788843457.073562:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 100 00000100:00100000:2.0:1788843457.073575:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+13:16870:x1875737775841024:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788843457.073972:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+13:16870:x1875737775841024:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 398us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.073981:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 100 00000100:00100000:1.0:1788843457.078811:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843457.079220:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775841152 00000100:00100000:2.0:1788843457.079234:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775841152 00000100:00100000:2.0:1788843457.079309:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 101 00000100:00100000:2.0:1788843457.079322:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c053050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+13:16870:x1875737775841152:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788843457.080111:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c053050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+13:16870:x1875737775841152:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 787us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.080121:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 101 00000100:00100000:3.0:1788843457.084149:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843457.085144:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775841280 00000100:00100000:0.0:1788843457.085159:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775841280 00000100:00100000:0.0:1788843457.085277:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 102 00000100:00100000:0.0:1788843457.085290:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c050850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+13:16882:x1875737775841280:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788843457.085736:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c050850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+13:16882:x1875737775841280:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 447us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843457.085745:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 102 00000100:00100000:1.0:1788843457.097256:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843457.097409:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775841408 00000100:00100000:2.0:1788843457.097423:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775841408 00000100:00100000:2.0:1788843457.097496:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 103 00000100:00100000:2.0:1788843457.097510:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+13:16882:x1875737775841408:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788843457.098788:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+13:16882:x1875737775841408:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 1271us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.098801:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 103 00000100:00100000:1.0:1788843457.120134:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843457.121956:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843457.122003:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843457.122067:0:19652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775842048 00000100:00100000:0.0:1788843457.122081:0:19652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775842048 00000100:00100000:0.0:1788843457.122172:0:19652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:0.0:1788843457.122185:0:19652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+5:2359:x1875737775842048:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843457.122295:0:19652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+5:2359:x1875737775842048:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 113us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843457.122325:0:19652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:1.0:1788843457.124737:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843457.126717:0:20132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775842176 00000100:00100000:3.0:1788843457.126739:0:20132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775842176 00000100:00100000:3.0:1788843457.126828:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:3.0:1788843457.126841:0:20132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f626edf3-537d-4eb9-9825-d3d39a257fe8+5:2359:x1875737775842176:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843457.126954:0:20132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f626edf3-537d-4eb9-9825-d3d39a257fe8+5:2359:x1875737775842176:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 115us (2230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843457.126963:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:2.0:1788843457.134086:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775841536 00000100:00100000:2.0:1788843457.134110:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775841536 00000100:00100000:2.0:1788843457.134205:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775841920 00000100:00100000:2.0:1788843457.134209:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775841920 00000100:00100000:2.0:1788843457.134257:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:2.0:1788843457.134268:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+7:2359:x1875737775841920:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843457.134416:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+7:2359:x1875737775841920:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 148us (12410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.134425:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:2.0:1788843457.134449:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:2.0:1788843457.134454:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2355:x1875737775841536:12345-192.168.203.29@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788843457.134484:0:18965:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2c801b84-6ce8-40ad-900b-f7b60a728195@192.168.203.29@tcp t0 exp 0000000000000000 cur 581 last 0 00000020:00000080:2.0:1788843457.134533:0:18965:0:(genops.c:1385:class_connect()) connect: client 2c801b84-6ce8-40ad-900b-f7b60a728195, cookie 0xc6b8ac1b09167e9 00000004:00100000:2.0:1788843457.135838:0:18965:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788843457.136272:0:18965:0:(import.c:65:import_set_state_nolock()) ffff8dab6ff0b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843457.136389:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c801b84-6ce8-40ad-900b-f7b60a728195+6:2355:x1875737775841536:12345-192.168.203.29@tcp:38:mount.lustre.0 Request processed in 1930us (16266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.136402:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:1.0:1788843457.142563:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843457.142616:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843457.142885:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775841664 00000100:00100000:0.0:1788843457.142898:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775841664 00000100:00100000:0.0:1788843457.142985:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775841792 00000100:00100000:0.0:1788843457.142988:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775841792 00000100:00100000:0.0:1788843457.143011:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:0.0:1788843457.143023:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c801b84-6ce8-40ad-900b-f7b60a728195+7:0:x1875737775841664:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788843457.143082:0:18967:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788843457.143178:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c801b84-6ce8-40ad-900b-f7b60a728195+7:0:x1875737775841664:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 156us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843457.143187:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:0.0:1788843457.143209:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:0.0:1788843457.143216:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c801b84-6ce8-40ad-900b-f7b60a728195+6:16870:x1875737775841792:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788843457.143227:0:18967:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788843457.143250:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c801b84-6ce8-40ad-900b-f7b60a728195+6:16870:x1875737775841792:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 35us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843457.143257:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00080000:3.0:1788843457.143376:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843457.145252:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843457.145459:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775842304 00000100:00100000:0.0:1788843457.145472:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775842304 00000100:00100000:0.0:1788843457.145610:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:0.0:1788843457.145622:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c801b84-6ce8-40ad-900b-f7b60a728195+6:16870:x1875737775842304:12345-192.168.203.29@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788843457.145745:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c801b84-6ce8-40ad-900b-f7b60a728195+6:16870:x1875737775842304:12345-192.168.203.29@tcp:40:mount.lustre.0 Request processed in 123us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843457.145753:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:3.0:1788843457.151212:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843457.151261:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843457.151298:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843457.151374:0:19650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775842432 00000100:00100000:0.0:1788843457.151409:0:19650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775842432 00000100:00100000:1.0:1788843457.151437:0:18969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775842688 00000100:00100000:1.0:1788843457.151443:0:18969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775842688 00000100:00100000:0.0:1788843457.151463:0:19650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775842560 00000100:00100000:0.0:1788843457.151468:0:19650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775842560 00000100:00100000:0.0:1788843457.151496:0:19650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:0.0:1788843457.151507:0:19650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1875737775842432:12345-192.168.203.29@tcp:8:mount.lustre.0 00000100:00100000:1.0:1788843457.151509:0:18969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:1.0:1788843457.151523:0:18969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c801b84-6ce8-40ad-900b-f7b60a728195+6:16870:x1875737775842688:12345-192.168.203.29@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788843457.151627:0:18969:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788843457.151728:0:18969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c801b84-6ce8-40ad-900b-f7b60a728195+6:16870:x1875737775842688:12345-192.168.203.29@tcp:33:mount.lustre.0 Request processed in 207us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843457.151737:0:18969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:1.0:1788843457.151782:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:1.0:1788843457.151787:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1875737775842560:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788843457.152377:0:19650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2c801b84-6ce8-40ad-900b-f7b60a728195@192.168.203.29@tcp t0 exp 0000000000000000 cur 581 last 0 00000020:00000080:0.0:1788843457.152428:0:19650:0:(genops.c:1385:class_connect()) connect: client 2c801b84-6ce8-40ad-900b-f7b60a728195, cookie 0xc6b8ac1b09167f0 00002000:00100000:0.0:1788843457.152444:0:19650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2c801b84-6ce8-40ad-900b-f7b60a728195/ffff8dab73d88000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788843457.152459:0:19650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788843457.153126:0:19650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788843457.153198:0:19650:0:(import.c:65:import_set_state_nolock()) ffff8dab6fe81800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843457.153622:0:19650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c801b84-6ce8-40ad-900b-f7b60a728195+6:2355:x1875737775842432:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 2112us (2355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843457.153634:0:19650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00010000:00080000:1.0:1788843457.154377:0:19651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2c801b84-6ce8-40ad-900b-f7b60a728195@192.168.203.29@tcp t0 exp 0000000000000000 cur 581 last 0 00000020:00000080:1.0:1788843457.154426:0:19651:0:(genops.c:1385:class_connect()) connect: client 2c801b84-6ce8-40ad-900b-f7b60a728195, cookie 0xc6b8ac1b09167f7 00002000:00100000:1.0:1788843457.154441:0:19651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2c801b84-6ce8-40ad-900b-f7b60a728195/ffff8daa411b6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788843457.154504:0:19651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788843457.154749:0:19651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788843457.155156:0:19651:0:(import.c:65:import_set_state_nolock()) ffff8dab50391800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843457.155235:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2c801b84-6ce8-40ad-900b-f7b60a728195+6:2355:x1875737775842560:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 3444us (3933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843457.155246:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:3.0:1788843457.334703:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843457.334814:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775842816 00000100:00100000:1.0:1788843457.334833:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775842816 00000100:00100000:1.0:1788843457.334935:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:1.0:1788843457.334949:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c801b84-6ce8-40ad-900b-f7b60a728195+6:16903:x1875737775842816:12345-192.168.203.29@tcp:101:mkdir.0 00010000:00010000:1.0:1788843457.334997:0:18966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843457.335027:0:18966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef200/0xc6b8ac1b09167fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084e61 expref: -99 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843457.335626:0:18966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceec00/0xc6b8ac1b0916805 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843457.335647:0:18966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceec00/0xc6b8ac1b0916805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843457.335668:0:18966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceec00/0xc6b8ac1b0916805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843457.335715:0:18966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788843457.335720:0:18966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788843457.335747:0:18966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceec00/0xc6b8ac1b0916805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843457.335780:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef200/0xc6b8ac1b09167fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e61 expref: 8 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843457.335803:0:18966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceec00/0xc6b8ac1b0916805 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e61 expref: 7 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843457.335813:0:18966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910200) 00010000:00010000:1.0:1788843457.335816:0:18966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788843457.335821:0:18966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab6fceec00, rc 0) 00000100:00100000:1.0:1788843457.335960:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c801b84-6ce8-40ad-900b-f7b60a728195+7:16903:x1875737775842816:12345-192.168.203.29@tcp:101:mkdir.0 Request processed in 1013us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843457.335969:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00010000:00010000:0.0:1788843457.796716:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843458.822572:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843458.886952:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795756928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843458.887027:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843458.887235:0:19653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795756928 00000100:00100000:3.0:1788843458.887243:0:19653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795756928 00000100:00100000:3.0:1788843458.887316:0:19653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788843458.887326:0:19653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795756928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843458.887391:0:19653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788843458.887457:0:19653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795756928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843458.887465:0:19653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788843458.888195:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795756928:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788843458.888593:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843459.397577:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795757056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843459.397681:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843459.397824:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795757056 00000100:00100000:1.0:1788843459.397835:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795757056 00000100:00100000:1.0:1788843459.397905:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788843459.397917:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795757056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843459.397961:0:19654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843459.398540:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795757056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 623us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843459.398550:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788843459.398621:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795757056:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788843459.398650:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788843459.400625:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:345dfd18-3e4c-44c0-bf46-62bd805326d9:3304:1875737795757184:0@lo:400:kworker.0 00000100:00100000:1.0:1788843459.400647:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795757312:0@lo:400:kworker.0 00000100:00100000:3.0:1788843459.400776:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795757440:0@lo:400:kworker.0 00000100:00100000:0.0:1788843459.402906:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843459.403025:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795757184 00000100:00100000:0.0:1788843459.403037:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795757184 00000100:00100000:0.0:1788843459.403154:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788843459.403175:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:3304:x1875737795757184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843459.403899:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:3304:x1875737795757184:12345-0@lo:400:kworker.0 Request processed in 724us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843459.403911:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788843459.403991:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:345dfd18-3e4c-44c0-bf46-62bd805326d9:3304:1875737795757184:0@lo:400:kworker.0 00000100:00100000:0.0:1788843459.404058:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795757568:0@lo:400:kworker.0 00000100:00100000:0.0:1788843459.404155:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843459.404482:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795757568 00000100:00100000:0.0:1788843459.404489:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795757568 00000100:00100000:0.0:1788843459.404553:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788843459.404562:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795757568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843459.404707:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795757568:12345-0@lo:400:kworker.0 Request processed in 147us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843459.404716:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788843459.406539:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795757568:0@lo:400:kworker.0 00000100:00080000:0.0:1788843459.406631:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843459.407898:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843459.408044:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795757312 00000100:00100000:0.0:1788843459.408054:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795757312 00000100:00100000:0.0:1788843459.408151:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788843459.408163:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795757312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843459.408456:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795757312:12345-0@lo:400:kworker.0 Request processed in 294us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843459.408465:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788843459.408536:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795757312:0@lo:400:kworker.0 00000100:00100000:3.0:1788843459.410233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843459.411363:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795757440 00000100:00100000:0.0:1788843459.411379:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795757440 00000100:00100000:0.0:1788843459.411471:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788843459.411494:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795757440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843459.411586:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795757440:12345-0@lo:400:kworker.0 Request processed in 97us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843459.411596:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788843459.414566:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795757440:0@lo:400:kworker.0 00000100:00080000:1.0:1788843459.414835:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788843459.847532:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788843459.963268:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f626edf3-537d-4eb9-9825-d3d39a257fe8 00000001:00100000:1.0:1788843459.963284:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2c801b84-6ce8-40ad-900b-f7b60a728195 00000001:00100000:2.0:1788843459.977710:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2c801b84-6ce8-40ad-900b-f7b60a728195 00000001:00100000:2.0:1788843459.986964:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2c801b84-6ce8-40ad-900b-f7b60a728195 00000001:02000400:1.0:1788843460.139891:0:20936:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788843460.870486:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843461.892614:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843462.295273:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843462.296384:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775842944 00000100:00100000:0.0:1788843462.296398:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775842944 00000100:00100000:0.0:1788843462.296465:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 105 00000100:00100000:0.0:1788843462.296476:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+13:2359:x1875737775842944:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843462.296558:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+13:2359:x1875737775842944:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 83us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843462.296566:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 105 00000100:00100000:0.0:1788843462.305401:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843462.305444:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843462.305469:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843462.305487:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843462.305506:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843462.305527:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843462.305555:0:20132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775843200 00000100:00100000:0.0:1788843462.305565:0:20132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775843200 00000100:00100000:0.0:1788843462.305615:0:20132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775843712 00000100:00100000:0.0:1788843462.305618:0:20132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775843712 00000100:00100000:0.0:1788843462.305632:0:20132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775843328 00000100:00100000:0.0:1788843462.305635:0:20132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775843328 00000100:00100000:0.0:1788843462.305646:0:20132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775843584 00000100:00100000:0.0:1788843462.305648:0:20132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775843584 00000100:00100000:0.0:1788843462.305664:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:0.0:1788843462.305673:0:20132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f626edf3-537d-4eb9-9825-d3d39a257fe8+5:2359:x1875737775843200:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843462.305742:0:20132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f626edf3-537d-4eb9-9825-d3d39a257fe8+5:2359:x1875737775843200:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 70us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843462.305763:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:0.0:1788843462.305793:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:0.0:1788843462.305800:0:20132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c801b84-6ce8-40ad-900b-f7b60a728195+5:2359:x1875737775843712:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843462.305826:0:20132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c801b84-6ce8-40ad-900b-f7b60a728195+5:2359:x1875737775843712:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 26us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843462.305832:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:0.0:1788843462.306009:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:0.0:1788843462.306020:0:20132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f626edf3-537d-4eb9-9825-d3d39a257fe8+5:2358:x1875737775843328:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843462.306048:0:20132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f626edf3-537d-4eb9-9825-d3d39a257fe8+5:2358:x1875737775843328:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 31us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843462.306054:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:0.0:1788843462.306066:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:0.0:1788843462.306072:0:20132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c801b84-6ce8-40ad-900b-f7b60a728195+5:2358:x1875737775843584:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843462.306093:0:20132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2c801b84-6ce8-40ad-900b-f7b60a728195+5:2358:x1875737775843584:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 21us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843462.306100:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:0.0:1788843462.306118:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775843072 00000100:00100000:0.0:1788843462.306121:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775843072 00000100:00100000:0.0:1788843462.306151:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775843456 00000100:00100000:0.0:1788843462.306154:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775843456 00000100:00100000:0.0:1788843462.306168:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:0.0:1788843462.306174:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+6:2359:x1875737775843072:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843462.306201:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+6:2359:x1875737775843072:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 27us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843462.306213:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:0.0:1788843462.306227:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:0.0:1788843462.306233:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c801b84-6ce8-40ad-900b-f7b60a728195+6:2359:x1875737775843456:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843462.306258:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c801b84-6ce8-40ad-900b-f7b60a728195+6:2359:x1875737775843456:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 25us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843462.306263:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00080000:0.0:1788843462.306290:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788843462.306294:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843462.306297:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788843462.918113:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788843463.830004:0:21084:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef56f0c00 20000000:00000080:1.0:1788843463.830021:0:21084:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dab75251c00 uarg=0000000000000000 20000000:01000000:1.0:1788843463.830060:0:21084:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788843463.830065:0:21084:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788843463.830070:0:21084:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788843463.830956:0:21085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788843463.831159:0:21084:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788843463.837539:0:21084:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788843463.837646:0:21084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dab6fcef600/0xc6b8ac1b091680c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843463.837668:0:21084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b09164cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b09164c4 expref: 18 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843463.837675:0:21084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab7ff89000/0xc6b8ac1b0916518 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0916511 expref: 18 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843463.837683:0:21084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab7ff89600/0xc6b8ac1b0916668 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0916661 expref: 18 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843463.837692:0:21084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab7ff88200/0xc6b8ac1b09167aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084dd5 expref: 12 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843463.837699:0:21084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8daa42696c00/0xc6b8ac1b09167e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e37 expref: 12 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843463.837706:0:21084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dab6fcef600/0xc6b8ac1b091680c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843463.837825:0:21084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8daa42696c00/0xc6b8ac1b09167e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084e37 expref: 12 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843463.837842:0:21084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8daa42696c00/0xc6b8ac1b09167e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084e37 expref: 12 pid: 18958 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843463.837859:0:21084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21084:1875737795757696:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843463.838009:0:21084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab7ff88200/0xc6b8ac1b09167aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084dd5 expref: 12 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843463.838045:0:21084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab7ff88200/0xc6b8ac1b09167aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084dd5 expref: 12 pid: 18959 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843463.838054:0:21084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21084:1875737795757824:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843463.838087:0:21084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab7ff89600/0xc6b8ac1b0916668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0916661 expref: 18 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843463.838095:0:21084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab7ff89600/0xc6b8ac1b0916668 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0916661 expref: 18 pid: 18958 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843463.838104:0:21084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21084:1875737795757952:0@lo:104: 00000100:00100000:1.0:1788843463.838146:0:21084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843463.838193:0:21084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab7ff89000/0xc6b8ac1b0916518 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0916511 expref: 18 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843463.838201:0:21084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab7ff89000/0xc6b8ac1b0916518 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0916511 expref: 18 pid: 18959 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843463.838210:0:21084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21084:1875737795758080:0@lo:104: 00000100:00100000:1.0:1788843463.838231:0:21084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843463.838303:0:21084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b09164cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b09164c4 expref: 18 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843463.838322:0:21084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b09164cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b09164c4 expref: 18 pid: 18960 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843463.838331:0:21084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21084:1875737795758208:0@lo:104: 00000100:00100000:1.0:1788843463.838386:0:21084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843463.839007:0:21084:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab514a8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788843463.839196:0:18949:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788843463.839209:0:18949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795757952 00000100:00100000:1.0:1788843463.839216:0:18949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795757952 00000100:00100000:1.0:1788843463.839256:0:18949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795758080 00000100:00100000:1.0:1788843463.839259:0:18949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795758080 00000100:00100000:1.0:1788843463.839270:0:18949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795758208 00000100:00100000:1.0:1788843463.839273:0:18949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795758208 00000100:00100000:1.0:1788843463.839285:0:18949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843463.839293:0:18949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:345dfd18-3e4c-44c0-bf46-62bd805326d9+5:21084:x1875737795757952:12345-0@lo:104: 00010000:00010000:1.0:1788843463.839317:0:18949:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89200/0xc6b8ac1b0916661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0916668 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843463.839764:0:18949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788843463.839770:0:18949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:345dfd18-3e4c-44c0-bf46-62bd805326d9+5:21084:x1875737795757952:12345-0@lo:104: Request processed in 478us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843463.839778:0:18949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843463.839797:0:18949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843463.839802:0:18949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:345dfd18-3e4c-44c0-bf46-62bd805326d9+4:21084:x1875737795758080:12345-0@lo:104: 00010000:00010000:1.0:1788843463.839809:0:18949:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88600/0xc6b8ac1b0916511 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0916518 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843463.839840:0:18949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788843463.839844:0:18949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:345dfd18-3e4c-44c0-bf46-62bd805326d9+4:21084:x1875737795758080:12345-0@lo:104: Request processed in 43us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843463.839849:0:18949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843463.839858:0:18949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843463.839863:0:18949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e660c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:345dfd18-3e4c-44c0-bf46-62bd805326d9+3:21084:x1875737795758208:12345-0@lo:104: 00010000:00010000:1.0:1788843463.839869:0:18949:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89c00/0xc6b8ac1b09164c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b09164cb expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843463.839906:0:18949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788843463.839911:0:18949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e660c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:345dfd18-3e4c-44c0-bf46-62bd805326d9+3:21084:x1875737795758208:12345-0@lo:104: Request processed in 48us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843463.839917:0:18949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788843463.840197:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788843463.840204:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89200/0xc6b8ac1b0916661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0916668 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.840211:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff89200 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843463.840215:0:18954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89200/0xc6b8ac1b0916661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0916668 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.840224:0:18954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89200/0xc6b8ac1b0916661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0916668 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843463.840231:0:18954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89200/0xc6b8ac1b0916661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0916668 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843463.840236:0:18954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788843463.840269:0:18954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89200/0xc6b8ac1b0916661 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0916668 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.840275:0:18954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843463.840293:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89200/0xc6b8ac1b0916661 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0916668 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.840322:0:18954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89200/0xc6b8ac1b0916661 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0916668 expref: -99 pid: 20374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.840335:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788843463.840338:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88600/0xc6b8ac1b0916511 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0916518 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.840362:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88600 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843463.840365:0:18954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88600/0xc6b8ac1b0916511 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0916518 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.840371:0:18954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88600/0xc6b8ac1b0916511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0916518 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843463.840377:0:18954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88600/0xc6b8ac1b0916511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0916518 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843463.840382:0:18954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788843463.840394:0:18954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88600/0xc6b8ac1b0916511 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0916518 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.840399:0:18954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843463.840404:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88600/0xc6b8ac1b0916511 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0916518 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.840409:0:18954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88600/0xc6b8ac1b0916511 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0916518 expref: -99 pid: 19649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.840420:0:18954:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843463.840427:0:18954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89c00/0xc6b8ac1b09164c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b09164cb expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.840433:0:18954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff89c00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843463.840435:0:18954:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89c00/0xc6b8ac1b09164c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b09164cb expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.840441:0:18954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89c00/0xc6b8ac1b09164c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b09164cb expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843463.840446:0:18954:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89c00/0xc6b8ac1b09164c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b09164cb expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843463.840451:0:18954:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788843463.840461:0:18954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89c00/0xc6b8ac1b09164c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b09164cb expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.840466:0:18954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843463.840480:0:18954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89c00/0xc6b8ac1b09164c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b09164cb expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.840487:0:18954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89c00/0xc6b8ac1b09164c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b09164cb expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.840500:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843463.840502:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843463.840504:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843463.840524:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:345dfd18-3e4c-44c0-bf46-62bd805326d9:3304:1875737795758336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843463.840566:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843463.840601:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843463.840606:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:345dfd18-3e4c-44c0-bf46-62bd805326d9:3304:1875737795758464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843463.840635:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843463.840662:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:345dfd18-3e4c-44c0-bf46-62bd805326d9:3306:1875737795758592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843463.840700:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843463.840732:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795758336 00000100:00100000:3.0:1788843463.840739:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795758336 00010000:00010000:3.0:1788843463.840765:0:18951:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab7ff89600/0xc6b8ac1b0916668 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0916661 expref: 19 pid: 18958 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843463.840781:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795758464 00000100:00100000:3.0:1788843463.840783:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795758464 00010000:00010000:3.0:1788843463.840794:0:18951:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab7ff89000/0xc6b8ac1b0916518 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0916511 expref: 20 pid: 18959 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843463.840804:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795758592 00000100:00100000:3.0:1788843463.840806:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795758592 00010000:00010000:3.0:1788843463.840815:0:18951:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b09164cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b09164c4 expref: 21 pid: 18960 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843463.840827:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843463.840833:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:345dfd18-3e4c-44c0-bf46-62bd805326d9+21:3304:x1875737795758336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843463.840844:0:18951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843463.840850:0:18951:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab7ff89600/0xc6b8ac1b0916668 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0916661 expref: 21 pid: 18958 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.840859:0:18951:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab7ff89600/0xc6b8ac1b0916668 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0916661 expref: 21 pid: 18958 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.840877:0:18951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843463.840907:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:345dfd18-3e4c-44c0-bf46-62bd805326d9+21:3304:x1875737795758336:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843463.840923:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843463.840937:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843463.840943:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:345dfd18-3e4c-44c0-bf46-62bd805326d9+20:3304:x1875737795758464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843463.840950:0:18951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843463.840954:0:18951:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab7ff89000/0xc6b8ac1b0916518 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0916511 expref: 20 pid: 18959 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.840962:0:18951:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab7ff89000/0xc6b8ac1b0916518 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0916511 expref: 20 pid: 18959 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.840971:0:18951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843463.840989:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:345dfd18-3e4c-44c0-bf46-62bd805326d9+20:3304:x1875737795758464:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843463.840994:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843463.841003:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788843463.841008:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffd1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:3306:x1875737795758592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843463.841013:0:18951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843463.841017:0:18951:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b09164cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b09164c4 expref: 19 pid: 18960 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.841174:0:18951:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b09164cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b09164c4 expref: 19 pid: 18960 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.841184:0:18951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843463.841209:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffd1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:3306:x1875737795758592:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843463.841216:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788843463.841276:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:345dfd18-3e4c-44c0-bf46-62bd805326d9:3306:1875737795758592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843463.841302:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:345dfd18-3e4c-44c0-bf46-62bd805326d9:3304:1875737795758464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843463.841321:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:345dfd18-3e4c-44c0-bf46-62bd805326d9:3304:1875737795758336:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843463.841689:0:21084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7ff89600/0xc6b8ac1b0916668 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0916661 expref: 18 pid: 18958 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843463.841701:0:21084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21084:1875737795757952:0@lo:104: 00010000:00010000:0.0:1788843463.841710:0:21084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7ff89000/0xc6b8ac1b0916518 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0916511 expref: 17 pid: 18959 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843463.841718:0:21084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21084:1875737795758080:0@lo:104: 00010000:00010000:0.0:1788843463.841726:0:21084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b09164cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b09164c4 expref: 16 pid: 18960 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843463.841733:0:21084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21084:1875737795758208:0@lo:104: 00000100:00100000:2.0:1788843463.841820:0:18948:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:2.0:1788843463.841852:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843463.841857:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843463.850690:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843463.850731:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843463.850810:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775843968 00000100:00100000:3.0:1788843463.850820:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775843968 00010000:00010000:3.0:1788843463.850856:0:18951:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab7ff88200/0xc6b8ac1b09167aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084dd5 expref: 13 pid: 18959 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843463.850892:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775843840 00000100:00100000:3.0:1788843463.850895:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775843840 00010000:00010000:3.0:1788843463.850909:0:18951:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8daa42696c00/0xc6b8ac1b09167e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084e37 expref: 14 pid: 18958 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843463.850925:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:3.0:1788843463.850933:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e27f4f77-381a-4316-945d-346e72200308+14:2359:x1875737775843968:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843463.850948:0:18951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843463.850953:0:18951:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab7ff88200/0xc6b8ac1b09167aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084dd5 expref: 14 pid: 18959 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.850964:0:18951:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab7ff88200/0xc6b8ac1b09167aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084dd5 expref: 14 pid: 18959 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.850987:0:18951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843463.851054:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e27f4f77-381a-4316-945d-346e72200308+14:2359:x1875737775843968:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 120us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843463.851061:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:3.0:1788843463.851078:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:3.0:1788843463.851085:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e27f4f77-381a-4316-945d-346e72200308+13:2359:x1875737775843840:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843463.851106:0:18951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843463.851111:0:18951:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8daa42696c00/0xc6b8ac1b09167e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084e37 expref: 13 pid: 18958 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.851121:0:18951:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8daa42696c00/0xc6b8ac1b09167e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084e37 expref: 13 pid: 18958 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.851133:0:18951:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dab6fcef600/0xc6b8ac1b091680c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 21084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.851142:0:18951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab6fcef600/0xc6b8ac1b091680c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 21084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.851158:0:18951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab6fcef600/0xc6b8ac1b091680c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.851165:0:18951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab6fcef600/0xc6b8ac1b091680c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.851172:0:18951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dab6fcef600/0xc6b8ac1b091680c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.851179:0:18951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dab6fcef600/0xc6b8ac1b091680c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.851185:0:18951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcef600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843463.851189:0:18951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dab6fcef600/0xc6b8ac1b091680c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.851196:0:18951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dab6fcef600/0xc6b8ac1b091680c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.851216:0:18951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dab6fcef600/0xc6b8ac1b091680c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843463.851226:0:18951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843463.851261:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e27f4f77-381a-4316-945d-346e72200308+13:2359:x1875737775843840:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 176us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843463.851267:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00010000:00010000:1.0:1788843463.852643:0:21084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8daa42696c00/0xc6b8ac1b09167e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084e37 expref: 12 pid: 18958 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843463.852661:0:21084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21084:1875737795757696:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843463.852674:0:21084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7ff88200/0xc6b8ac1b09167aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084dd5 expref: 11 pid: 18959 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843463.852682:0:21084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21084:1875737795757824:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843463.852718:0:21084:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dab6fcef600/0xc6b8ac1b091680c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843463.852729:0:21084:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dab6fcef600/0xc6b8ac1b091680c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843463.852736:0:21084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dab6fcef600/0xc6b8ac1b091680c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843463.852742:0:21084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab6fcef600/0xc6b8ac1b091680c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843463.943173:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843464.009280:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795758720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843464.009383:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843464.009507:0:20349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795758720 00000100:00100000:1.0:1788843464.009516:0:20349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795758720 00000100:00100000:1.0:1788843464.009581:0:20349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788843464.009599:0:20349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795758720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843464.009633:0:20349:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788843464.009682:0:20349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795758720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843464.009689:0:20349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788843464.009737:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795758720:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788843464.009867:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843464.516967:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795759232:0@lo:400:kworker.0 00000100:00100000:1.0:1788843464.517041:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843464.517104:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843464.517110:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795759104:0@lo:400:kworker.0 00000100:00100000:1.0:1788843464.517133:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843464.517204:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795758848:0@lo:400:kworker.0 00000100:00100000:3.0:1788843464.517238:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843464.517274:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843464.517279:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795758976:0@lo:400:kworker.0 00000100:00100000:3.0:1788843464.517324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843464.517374:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795759232 00000100:00100000:3.0:1788843464.517381:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795759232 00000100:00100000:3.0:1788843464.517428:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795759104 00000100:00100000:3.0:1788843464.517431:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795759104 00000100:00100000:3.0:1788843464.517444:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795758976 00000100:00100000:3.0:1788843464.517446:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795758976 00000100:00100000:3.0:1788843464.517461:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788843464.517469:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795759232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843464.517520:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795759232:12345-0@lo:400:kworker.0 Request processed in 52us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843464.517528:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788843464.517544:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788843464.517564:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795759104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843464.517594:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795759104:12345-0@lo:400:kworker.0 Request processed in 32us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843464.517599:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788843464.517611:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788843464.517617:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795758976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843464.517646:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795758976:12345-0@lo:400:kworker.0 Request processed in 29us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843464.517651:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788843464.517668:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843464.517695:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795758976:0@lo:400:kworker.0 00000100:00100000:3.0:1788843464.517724:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795759104:0@lo:400:kworker.0 00000100:00100000:3.0:1788843464.517737:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795759232:0@lo:400:kworker.0 00000100:00100000:3.0:1788843464.520268:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795759360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843464.520384:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843464.521077:0:20132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795758848 00000100:00100000:1.0:1788843464.521087:0:20132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795758848 00000100:00100000:1.0:1788843464.521151:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788843464.521160:0:20132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795758848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843464.521226:0:20132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795758848:12345-0@lo:400:kworker.0 Request processed in 66us (3986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843464.521233:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788843464.521276:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795758848:0@lo:400:kworker.0 00000100:00100000:0.0:1788843464.521444:0:19653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795759360 00000100:00100000:0.0:1788843464.521462:0:19653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795759360 00000100:00100000:0.0:1788843464.521496:0:19653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788843464.521503:0:19653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795759360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843464.521529:0:19653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843464.521578:0:19653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795759360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843464.521584:0:19653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788843464.521619:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795759360:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788843464.521893:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788843464.964574:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788843465.092671:0:18962:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788843465.092680:0:18962:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab6fd9c000 from 10 10000000:01000000:3.0:1788843465.092686:0:18962:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788843465.092858:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41533400/0xc6b8ac1b0916813 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.092870:0:18962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab41533400/0xc6b8ac1b0916813 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.092881:0:18962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab41533400/0xc6b8ac1b0916813 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843465.092923:0:18962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795759488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788843465.093128:0:18962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843465.093258:0:18962:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41dda840 going to sleep for 11 seconds 00000100:00100000:0.0:1788843465.094973:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795759488 00000100:00100000:0.0:1788843465.094985:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795759488 00000100:00100000:0.0:1788843465.095051:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788843465.095065:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+16:18962:x1875737795759488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843465.095080:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843465.095099:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8daa42696600/0xc6b8ac1b091681a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0916813 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.095123:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8daa42696600/0xc6b8ac1b091681a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0916813 expref: 17 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.095134:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8daa42696600/0xc6b8ac1b091681a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0916813 expref: 17 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.095142:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8daa42696600, rc 0) 00000100:00100000:0.0:1788843465.095476:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+17:18962:x1875737795759488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 416us (2348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843465.095484:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788843465.095593:0:18962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795759488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843465.095612:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab41533400/0xc6b8ac1b0916813 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b091681a expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.095622:0:18962:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab41533400/0xc6b8ac1b0916813 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b091681a expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843465.095691:0:18962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795759616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843465.096069:0:18962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843465.096110:0:18962:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41dda840 going to sleep for 11 seconds 00000100:00100000:0.0:1788843465.096306:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795759616 00000100:00100000:0.0:1788843465.096313:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795759616 00000100:00100000:0.0:1788843465.096428:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788843465.096436:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+17:18962:x1875737795759616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843465.096743:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+17:18962:x1875737795759616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 307us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843465.096751:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788843465.096818:0:18962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795759616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843465.096857:0:18962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795759744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843465.096896:0:18962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843465.098123:0:18962:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41dda840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843465.098307:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795759744 00000100:00100000:2.0:1788843465.098316:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795759744 00000100:00100000:2.0:1788843465.098369:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788843465.098378:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+17:18962:x1875737795759744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843465.098963:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+17:18962:x1875737795759744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 584us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843465.098971:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788843465.099309:0:18962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795759744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788843465.109214:0:21097:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788843465.110048:0:18962:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788843465.110075:0:18962:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788843465.110087:0:18962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41533400/0xc6b8ac1b0916813 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b091681a expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.110099:0:18962:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab41533400/0xc6b8ac1b0916813 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b091681a expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843465.110109:0:18962:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788843465.110112:0:18962:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab441fa800 from 10 10000000:01000000:0.0:1788843465.110114:0:18962:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788843465.110165:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8daa42697200/0xc6b8ac1b0916821 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.110173:0:18962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8daa42697200/0xc6b8ac1b0916821 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.110183:0:18962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8daa42697200/0xc6b8ac1b0916821 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843465.110209:0:18962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795759872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843465.110273:0:18962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843465.110324:0:18962:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab603b5240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843465.110479:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795759872 00000100:00100000:2.0:1788843465.110487:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795759872 00000100:00100000:2.0:1788843465.110544:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788843465.110554:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+17:18962:x1875737795759872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843465.110567:0:18959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843465.110580:0:18959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0916828 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0916821 expref: -99 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.110604:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0916828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0916821 expref: 18 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.110615:0:18959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0916828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0916821 expref: 18 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.110622:0:18959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c5400, rc 0) 00000100:00100000:2.0:1788843465.110670:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+18:18962:x1875737795759872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843465.110676:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788843465.111055:0:18962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795759872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843465.111071:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8daa42697200/0xc6b8ac1b0916821 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916828 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.111080:0:18962:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8daa42697200/0xc6b8ac1b0916821 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0916828 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843465.111151:0:18962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795760000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843465.111199:0:18962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843465.111233:0:18962:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41dda0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843465.111336:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795760000 00000100:00100000:0.0:1788843465.111375:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795760000 00000100:00100000:0.0:1788843465.111413:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788843465.111421:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+18:18962:x1875737795760000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843465.111933:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+18:18962:x1875737795760000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 511us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843465.111941:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788843465.112081:0:18962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795760000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843465.112118:0:18962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795760128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843465.112172:0:18962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843465.112203:0:18962:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41dda0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843465.112309:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795760128 00000100:00100000:0.0:1788843465.112313:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795760128 00000100:00100000:0.0:1788843465.112372:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788843465.112381:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+18:18962:x1875737795760128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843465.112694:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+18:18962:x1875737795760128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 313us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843465.112701:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788843465.113893:0:18962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795760128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788843465.115030:0:21098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788843465.115281:0:18962:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788843465.115316:0:18962:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788843465.115327:0:18962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8daa42697200/0xc6b8ac1b0916821 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916828 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.115338:0:18962:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8daa42697200/0xc6b8ac1b0916821 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916828 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843465.115365:0:18962:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788843465.115368:0:18962:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab7c18f800 from 10 10000000:01000000:3.0:1788843465.115371:0:18962:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788843465.115415:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b091682f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.115424:0:18962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b091682f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.115434:0:18962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b091682f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843465.115484:0:18962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795760256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788843465.115682:0:18962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843465.115841:0:18962:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41dda0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843465.120456:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795760256 00000100:00100000:2.0:1788843465.120619:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795760256 00000100:00100000:2.0:1788843465.120733:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788843465.120743:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+18:18962:x1875737795760256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843465.120760:0:18959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843465.120779:0:18959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab821c4e00/0xc6b8ac1b0916836 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b091682f expref: -99 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.120825:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab821c4e00/0xc6b8ac1b0916836 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b091682f expref: 19 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.120837:0:18959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab821c4e00/0xc6b8ac1b0916836 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b091682f expref: 19 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.120847:0:18959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4e00, rc 0) 00000100:00100000:2.0:1788843465.120967:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:18962:x1875737795760256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 226us (5285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843465.120975:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788843465.126917:0:18962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795760256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843465.126949:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b091682f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916836 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.126962:0:18962:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b091682f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0916836 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843465.127039:0:18962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795760384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843465.127096:0:18962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843465.127138:0:18962:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41dda0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843465.128305:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795760384 00000100:00100000:0.0:1788843465.128317:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795760384 00000100:00100000:0.0:1788843465.128396:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788843465.128407:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:18962:x1875737795760384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843465.130075:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:18962:x1875737795760384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1663us (2973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843465.130087:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788843465.131611:0:18962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795760384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843465.131981:0:18962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795760512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843465.132058:0:18962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843465.132100:0:18962:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46aa7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843465.132124:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795760512 00000100:00100000:0.0:1788843465.132131:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795760512 00000100:00100000:0.0:1788843465.132193:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788843465.132203:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:18962:x1875737795760512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843465.132422:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:18962:x1875737795760512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843465.132437:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788843465.132589:0:18962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:345dfd18-3e4c-44c0-bf46-62bd805326d9:18962:1875737795760512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788843465.134979:0:21099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788843465.137064:0:18962:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788843465.137097:0:18962:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788843465.137109:0:18962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b091682f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916836 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.137122:0:18962:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b091682f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916836 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843465.635978:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843465.636123:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775844096 00000100:00100000:1.0:1788843465.636135:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775844096 00000100:00100000:1.0:1788843465.636234:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:1.0:1788843465.636246:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+6:17365:x1875737775844096:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788843465.636269:0:18966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843465.636289:0:18966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef600/0xc6b8ac1b091683d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084e68 expref: -99 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.636405:0:18966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef400/0xc6b8ac1b0916844 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.636420:0:18966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef400/0xc6b8ac1b0916844 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.636433:0:18966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef400/0xc6b8ac1b0916844 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.636448:0:18966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef000/0xc6b8ac1b091684b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.636455:0:18966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef000/0xc6b8ac1b091684b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.636462:0:18966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef000/0xc6b8ac1b091684b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.637010:0:18966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefa00/0xc6b8ac1b0916852 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.637021:0:18966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefa00/0xc6b8ac1b0916852 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.637035:0:18966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefa00/0xc6b8ac1b0916852 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843465.637062:0:18966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788843465.637066:0:18966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788843465.637102:0:18966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefa00/0xc6b8ac1b0916852 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788843465.637494:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788843465.637617:0:18966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef400/0xc6b8ac1b0916844 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.637627:0:18966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef400/0xc6b8ac1b0916844 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.637633:0:18966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef400/0xc6b8ac1b0916844 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.637638:0:18966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcef400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843465.637642:0:18966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef400/0xc6b8ac1b0916844 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.637651:0:18966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef400/0xc6b8ac1b0916844 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.637664:0:18966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910200) 00010000:00010000:1.0:1788843465.637667:0:18966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843465.637671:0:18966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef400/0xc6b8ac1b0916844 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.637676:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef400/0xc6b8ac1b0916844 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.637703:0:18966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef000/0xc6b8ac1b091684b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.637710:0:18966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef000/0xc6b8ac1b091684b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.637716:0:18966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef000/0xc6b8ac1b091684b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.637721:0:18966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcef000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843465.637724:0:18966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef000/0xc6b8ac1b091684b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.637730:0:18966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef000/0xc6b8ac1b091684b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.637738:0:18966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8daa411aaf00) 00010000:00010000:1.0:1788843465.637740:0:18966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843465.637743:0:18966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef000/0xc6b8ac1b091684b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.637749:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef000/0xc6b8ac1b091684b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.637793:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef600/0xc6b8ac1b091683d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e68 expref: 8 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.637807:0:18966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefa00/0xc6b8ac1b0916852 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e68 expref: 7 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.637825:0:18966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8daa411aa900) 00010000:00010000:1.0:1788843465.637828:0:18966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788843465.637830:0:18966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab6fcefa00, rc 0) 00000100:00100000:1.0:1788843465.638136:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+7:17365:x1875737775844096:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 1891us (2167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843465.638145:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:3.0:1788843465.659526:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843465.659684:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775844352 00000100:00100000:0.0:1788843465.659700:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775844352 00000100:00100000:0.0:1788843465.659783:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:0.0:1788843465.659795:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+7:17365:x1875737775844352:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843465.659815:0:18967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843465.659839:0:18967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916859 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084e6f expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.659911:0:18967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916860 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.659924:0:18967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916860 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.659934:0:18967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916860 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.659948:0:18967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b0916867 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.659972:0:18967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b0916867 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.659980:0:18967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b0916867 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.661796:0:18967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697400/0xc6b8ac1b091686e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.661819:0:18967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697400/0xc6b8ac1b091686e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.661829:0:18967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697400/0xc6b8ac1b091686e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843465.661845:0:18967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788843465.662062:0:18967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916860 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.662070:0:18967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916860 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.662076:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916860 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.662081:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42696a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843465.662085:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916860 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.662092:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916860 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.662115:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8daa411aa900) 00010000:00010000:0.0:1788843465.662118:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843465.662122:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916860 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.662128:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916860 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.662143:0:18967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b0916867 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.662149:0:18967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b0916867 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.662154:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b0916867 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.662159:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42696400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843465.662162:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b0916867 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.662168:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b0916867 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.662176:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8dab50f54d00) 00010000:00010000:0.0:1788843465.662178:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843465.662181:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b0916867 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.662186:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b0916867 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.668213:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916859 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e6f expref: 10 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.668243:0:18967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697400/0xc6b8ac1b091686e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e6f expref: 9 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.668252:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dab50f54900) 00010000:00010000:2.0:1788843465.668255:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843465.668258:0:18967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8daa42697400, rc 0) 00000100:00100000:2.0:1788843465.668405:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+9:17365:x1875737775844352:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 8610us (8892us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788843465.668414:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:0.0:1788843465.678991:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843465.679097:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775844480 00000100:00100000:3.0:1788843465.679111:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775844480 00000100:00100000:3.0:1788843465.679189:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 115 00000100:00100000:3.0:1788843465.679200:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+11:16754:x1875737775844480:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843465.679222:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843465.679247:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab82054000/0xc6b8ac1b091687c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084e76 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.679458:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab82054000/0xc6b8ac1b091687c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e76 expref: 12 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.679495:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab82054000/0xc6b8ac1b091687c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e76 expref: 12 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.679506:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82054000, rc 0) 00000100:00100000:3.0:1788843465.679589:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+12:16754:x1875737775844480:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 390us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843465.679597:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 115 00000100:00100000:3.0:1788843465.684517:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843465.684722:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775844608 00000100:00100000:1.0:1788843465.684736:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775844608 00000100:00100000:1.0:1788843465.684829:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:1.0:1788843465.684842:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+9:17365:x1875737775844608:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788843465.684986:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+9:17365:x1875737775844608:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 Request processed in 147us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843465.684995:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:1.0:1788843465.685933:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843465.686020:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775844736 00000100:00100000:2.0:1788843465.686029:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775844736 00000100:00100000:2.0:1788843465.686080:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 116 00000100:00100000:2.0:1788843465.686089:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+12:16754:x1875737775844736:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843465.686549:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+12:16754:x1875737775844736:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 460us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843465.686559:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 116 00000100:00100000:0.0:1788843465.699421:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843465.705576:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775844864 00000100:00100000:2.0:1788843465.705598:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775844864 00000100:00100000:2.0:1788843465.705764:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:2.0:1788843465.705776:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+9:17370:x1875737775844864:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843465.705804:0:18967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843465.705839:0:18967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4200/0xc6b8ac1b0916883 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084e7d expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.705923:0:18967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b091688a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.705940:0:18967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b091688a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.705953:0:18967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b091688a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.710876:0:18967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0916891 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.711010:0:18967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0916891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.711025:0:18967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0916891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843465.711202:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00010000:00010000:2.0:1788843465.711256:0:18967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b091688a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.711274:0:18967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b091688a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.711282:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b091688a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.711289:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843465.711305:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b091688a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.711315:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b091688a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.711331:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910200) 00010000:00010000:2.0:1788843465.711334:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788843465.711368:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775844992 00010000:00010000:2.0:1788843465.711370:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b091688a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.711382:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b091688a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843465.711383:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775844992 00010000:00010000:2.0:1788843465.711403:0:18967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0916891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.711409:0:18967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0916891 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.711415:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0916891 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.711420:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843465.711431:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0916891 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.711438:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0916891 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.711455:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8dab54910c00) 00000100:00100000:0.0:1788843465.711459:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 117 00010000:00010000:2.0:1788843465.711463:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843465.711469:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0916891 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843465.711478:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+12:16754:x1875737775844992:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00010000:00010000:2.0:1788843465.711482:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0916891 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.711540:0:18967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4200/0xc6b8ac1b0916883 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e7d expref: 10 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843465.711761:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+12:16754:x1875737775844992:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 287us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843465.711771:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 117 00010000:00010000:2.0:1788843465.714845:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910200) 00010000:00010000:2.0:1788843465.714850:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843465.714861:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4200/0xc6b8ac1b0916883 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e7d expref: 10 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.714882:0:18967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4200, rc 0) 00000100:00100000:2.0:1788843465.715538:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+9:17370:x1875737775844864:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 9760us (16127us total) trans 0 rc 301/301 00000100:00100000:2.0:1788843465.715548:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:2.0:1788843465.716038:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843465.716231:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775845120 00000100:00100000:3.0:1788843465.716243:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775845120 00000100:00100000:3.0:1788843465.716395:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 118 00000100:00100000:3.0:1788843465.716407:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+12:16754:x1875737775845120:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843465.716438:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843465.716463:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0916898 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084e84 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.716499:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0916898 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e84 expref: 13 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.716513:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0916898 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e84 expref: 13 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.716524:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82054a00, rc 0) 00000100:00100000:3.0:1788843465.716600:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+13:16754:x1875737775845120:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 195us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843465.716629:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 118 00000100:00100000:1.0:1788843465.719078:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843465.719171:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775845248 00000100:00100000:3.0:1788843465.719183:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775845248 00000100:00100000:3.0:1788843465.719254:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 119 00000100:00100000:3.0:1788843465.719265:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+13:16754:x1875737775845248:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843465.719693:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e27f4f77-381a-4316-945d-346e72200308+13:16754:x1875737775845248:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 428us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843465.719713:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 119 00000100:00100000:2.0:1788843465.727185:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843465.727320:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843465.727470:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775845376 00000100:00100000:0.0:1788843465.727486:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775845376 00000100:00100000:0.0:1788843465.727576:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 120 00000100:00100000:0.0:1788843465.727589:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+13:16754:x1875737775845376:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843465.727890:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e27f4f77-381a-4316-945d-346e72200308+13:16754:x1875737775845376:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 303us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843465.727899:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 120 00000100:00100000:3.0:1788843465.729649:0:18974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775845504 00000100:00100000:3.0:1788843465.729664:0:18974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775845504 00000100:00100000:3.0:1788843465.729729:0:18974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:3.0:1788843465.729742:0:18974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f626edf3-537d-4eb9-9825-d3d39a257fe8+9:17370:x1875737775845504:12345-192.168.203.29@tcp:700:lfs.0 00000100:00100000:3.0:1788843465.729866:0:18974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f626edf3-537d-4eb9-9825-d3d39a257fe8+9:17370:x1875737775845504:12345-192.168.203.29@tcp:700:lfs.0 Request processed in 126us (2544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843465.729874:0:18974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:2.0:1788843465.745158:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843465.745412:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775845760 00000100:00100000:0.0:1788843465.745425:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775845760 00000100:00100000:0.0:1788843465.745506:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:0.0:1788843465.745520:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+9:17370:x1875737775845760:12345-192.168.203.29@tcp:36:lfs.0 00010000:00010000:0.0:1788843465.745739:0:18965:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843465.745775:0:18965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b09167cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084dff expref: 9 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.745801:0:18965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910200) 00010000:00010000:0.0:1788843465.745881:0:18965:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843465.746241:0:18965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091689f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.746262:0:18965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceec00/0xc6b8ac1b0916805 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e61 expref: 5 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.746271:0:18965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091689f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.746325:0:18965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceec00/0xc6b8ac1b0916805 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084e61 expref: 5 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843465.746703:0:18965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceec00/0xc6b8ac1b0916805 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084e61 expref: 5 pid: 18966 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843465.746726:0:18965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc1ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18965:1875737795760640:192.168.203.29@tcp:104: 00000100:00100000:0.0:1788843465.746876:0:18965:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab452ec780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843465.750322:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843465.750438:0:18965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc1ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18965:1875737795760640:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843465.750474:0:18965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091689f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843465.750643:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775845888 00000100:00100000:3.0:1788843465.750653:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775845888 00010000:00010000:3.0:1788843465.750733:0:18951:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceec00/0xc6b8ac1b0916805 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084e61 expref: 6 pid: 18966 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843465.750780:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:3.0:1788843465.750792:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c801b84-6ce8-40ad-900b-f7b60a728195+6:2359:x1875737775845888:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843465.750812:0:18951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843465.750820:0:18951:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceec00/0xc6b8ac1b0916805 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084e61 expref: 6 pid: 18966 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.750856:0:18951:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceec00/0xc6b8ac1b0916805 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084e61 expref: 6 pid: 18966 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.750891:0:18951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceec00/0xc6b8ac1b0916805 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084e61 expref: 6 pid: 18966 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.750914:0:18951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910200) 00010000:00010000:3.0:1788843465.750921:0:18951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091689f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.750931:0:18951:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091689f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.750941:0:18951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091689f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.750972:0:18951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843465.751044:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c801b84-6ce8-40ad-900b-f7b60a728195+5:2359:x1875737775845888:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 253us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843465.751053:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00080000:0.0:1788843465.751487:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788843465.751506:0:18965:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091689f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.751517:0:18965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091689f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.751552:0:18965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b09168a6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.751565:0:18965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b09168a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.751574:0:18965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b09168a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843465.753385:0:18965:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788843465.753409:0:18965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091689f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.753421:0:18965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091689f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.753428:0:18965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091689f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.753447:0:18965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42697000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843465.753453:0:18965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091689f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.753463:0:18965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091689f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.753484:0:18965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910200) 00010000:00010000:3.0:1788843465.753488:0:18965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843465.753493:0:18965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091689f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.753499:0:18965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091689f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843465.753525:0:18965:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b40402f9 reply state 00000000b48d798d transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b09168a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843465.753535:0:18965:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788843465.753678:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+10:17370:x1875737775845760:12345-192.168.203.29@tcp:36:lfs.0 Request processed in 8156us (8530us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788843465.753690:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00010000:00010000:3.0:1788843465.773947:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b09168a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.773971:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b09168a6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.773981:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b09168a6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.774000:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843465.774006:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b09168a6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.774015:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b09168a6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.774038:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8dab54910c00) 00010000:00010000:3.0:1788843465.774041:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843465.774047:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b09168a6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.774054:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b09168a6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843465.871701:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843465.871825:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775846016 00000100:00100000:2.0:1788843465.871840:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775846016 00000100:00100000:2.0:1788843465.871924:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:2.0:1788843465.871936:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+9:17381:x1875737775846016:12345-192.168.203.29@tcp:101:lctl.0 00010000:00010000:2.0:1788843465.871965:0:18967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843465.871993:0:18967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b09168ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084e8b expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.872087:0:18967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375000/0xc6b8ac1b09168b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.872104:0:18967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375000/0xc6b8ac1b09168b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.872135:0:18967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375000/0xc6b8ac1b09168b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843465.872185:0:18967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788843465.872189:0:18967:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843465.872234:0:18967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375000/0xc6b8ac1b09168b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.872264:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b09168ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e8b expref: 11 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.872287:0:18967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375000/0xc6b8ac1b09168b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e8b expref: 10 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.872307:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843465.872310:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843465.872314:0:18967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375000, rc 0) 00000100:00100000:2.0:1788843465.872450:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+10:17381:x1875737775846016:12345-192.168.203.29@tcp:101:lctl.0 Request processed in 516us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843465.872461:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:0.0:1788843465.896483:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843465.896664:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775846144 00000100:00100000:3.0:1788843465.896679:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775846144 00000100:00100000:3.0:1788843465.896764:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:3.0:1788843465.896778:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c801b84-6ce8-40ad-900b-f7b60a728195+5:17382:x1875737775846144:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843465.896805:0:18965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843465.896833:0:18965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09168bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084e92 expref: -99 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.896918:0:18965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09168c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.896936:0:18965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09168c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.896969:0:18965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09168c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843465.897018:0:18965:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788843465.897022:0:18965:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788843465.897127:0:18965:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09168c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.897167:0:18965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09168bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e92 expref: 7 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.897196:0:18965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09168c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e92 expref: 6 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843465.897207:0:18965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:3.0:1788843465.897210:0:18965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843465.897215:0:18965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82055e00, rc 0) 00000100:00100000:3.0:1788843465.897298:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c801b84-6ce8-40ad-900b-f7b60a728195+6:17382:x1875737775846144:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 516us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843465.897306:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:0.0:1788843465.908554:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843465.908712:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775846272 00000100:00100000:1.0:1788843465.908727:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775846272 00000100:00100000:1.0:1788843465.908809:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:1.0:1788843465.908821:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c801b84-6ce8-40ad-900b-f7b60a728195+6:17382:x1875737775846272:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1788843465.908847:0:18966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843465.908875:0:18966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceee00/0xc6b8ac1b09168c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084e99 expref: -99 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.908963:0:18966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b09168d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.908999:0:18966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b09168d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909013:0:18966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b09168d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909030:0:18966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909222:0:18966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909233:0:18966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909581:0:18966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceea00/0xc6b8ac1b09168de lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909591:0:18966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceea00/0xc6b8ac1b09168de lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909598:0:18966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceea00/0xc6b8ac1b09168de lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843465.909640:0:18966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788843465.909644:0:18966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788843465.909674:0:18966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceea00/0xc6b8ac1b09168de lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909688:0:18966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b09168d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909708:0:18966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b09168d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909714:0:18966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b09168d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909721:0:18966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcefc00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843465.909727:0:18966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b09168d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909736:0:18966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b09168d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909752:0:18966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:1.0:1788843465.909756:0:18966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843465.909762:0:18966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b09168d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909768:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b09168d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909785:0:18966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909791:0:18966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909797:0:18966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909803:0:18966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcef800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843465.909812:0:18966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909819:0:18966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909828:0:18966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8daa411aaf00) 00010000:00010000:1.0:1788843465.909830:0:18966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843465.909833:0:18966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909838:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909878:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceee00/0xc6b8ac1b09168c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e99 expref: 8 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909894:0:18966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceea00/0xc6b8ac1b09168de lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e99 expref: 7 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.909901:0:18966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8daa411aa800) 00010000:00010000:1.0:1788843465.909903:0:18966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788843465.909906:0:18966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab6fceea00, rc 0) 00000100:00100000:1.0:1788843465.911738:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c801b84-6ce8-40ad-900b-f7b60a728195+7:17382:x1875737775846272:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 2904us (3183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843465.911753:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:1.0:1788843465.928740:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843465.929100:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775846528 00000100:00100000:2.0:1788843465.929114:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775846528 00000100:00100000:2.0:1788843465.929579:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:2.0:1788843465.929595:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c801b84-6ce8-40ad-900b-f7b60a728195+7:17382:x1875737775846528:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843465.929622:0:18967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843465.929650:0:18967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09168e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084ea0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843465.929802:0:18967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788843465.929974:0:18967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09168e5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ea0 expref: 9 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.929992:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843465.929996:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788843465.930003:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09168e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ea0 expref: 9 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.930021:0:18967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374c00, rc 0) 00000100:00100000:2.0:1788843465.930123:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c801b84-6ce8-40ad-900b-f7b60a728195+8:17382:x1875737775846528:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 533us (1398us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788843465.930132:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:2.0:1788843465.933534:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843465.934013:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775846784 00000100:00100000:1.0:1788843465.934028:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775846784 00000100:00100000:1.0:1788843465.934102:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:1.0:1788843465.934132:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c801b84-6ce8-40ad-900b-f7b60a728195+8:17382:x1875737775846784:12345-192.168.203.29@tcp:36:lfs.0 00010000:00010000:1.0:1788843465.934221:0:18966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843465.934255:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceea00/0xc6b8ac1b09168de lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084e99 expref: 8 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.934279:0:18966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8daa411aa800) 00010000:00010000:1.0:1788843465.934304:0:18966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843465.934526:0:18966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168f3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.934543:0:18966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168f3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.934554:0:18966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168f3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843465.935068:0:18966:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000433aa4a2 reply state 0000000086731329 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168f3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843465.935082:0:18966:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788843465.935092:0:18966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788843465.935614:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c801b84-6ce8-40ad-900b-f7b60a728195+9:17382:x1875737775846784:12345-192.168.203.29@tcp:36:lfs.0 Request processed in 1480us (2090us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788843465.935625:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 24 00010000:00010000:2.0:1788843465.938404:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168f3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.938434:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168f3 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.938444:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168f3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.938451:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcef800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843465.938457:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168f3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.938466:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168f3 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.938503:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8daa411aaf00) 00010000:00010000:2.0:1788843465.938506:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788843465.938513:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168f3 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.938520:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef800/0xc6b8ac1b09168f3 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843465.941837:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843465.941939:0:18968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775847040 00000100:00100000:1.0:1788843465.941953:0:18968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775847040 00000100:00100000:1.0:1788843465.942026:0:18968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:1.0:1788843465.942037:0:18968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c801b84-6ce8-40ad-900b-f7b60a728195+8:17382:x1875737775847040:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:1.0:1788843465.942553:0:18968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c801b84-6ce8-40ad-900b-f7b60a728195+9:17382:x1875737775847040:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 515us (728us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788843465.942583:0:18968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:1.0:1788843465.966566:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843465.971324:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775847296 00000100:00100000:2.0:1788843465.971406:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775847296 00000100:00100000:2.0:1788843465.971511:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:2.0:1788843465.971526:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c801b84-6ce8-40ad-900b-f7b60a728195+9:17382:x1875737775847296:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843465.971563:0:18967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843465.971593:0:18967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09168fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084ea7 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.971715:0:18967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916901 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.971733:0:18967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916901 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.971747:0:18967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916901 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.971764:0:18967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0916908 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.971771:0:18967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0916908 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.971797:0:18967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0916908 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843465.972220:0:18967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788843465.972384:0:18967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916901 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.972394:0:18967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916901 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.972401:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916901 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.972408:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843465.972413:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916901 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.972420:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916901 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.972435:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843465.972438:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843465.972443:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916901 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.972449:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916901 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.972465:0:18967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0916908 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.972486:0:18967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0916908 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.972493:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0916908 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.972498:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843465.972501:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0916908 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.972507:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0916908 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.972515:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8dab54910500) 00010000:00010000:2.0:1788843465.972517:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843465.972520:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0916908 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.972526:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0916908 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.972575:0:18967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09168fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ea7 expref: 11 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.972587:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843465.972590:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788843465.972594:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09168fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ea7 expref: 11 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843465.972604:0:18967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374c00, rc 0) 00000100:00100000:2.0:1788843465.975244:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2c801b84-6ce8-40ad-900b-f7b60a728195+10:17382:x1875737775847296:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 3692us (8662us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1788843465.975263:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:2.0:1788843465.976584:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843465.976662:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775847424 00000100:00100000:1.0:1788843465.976675:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775847424 00000100:00100000:1.0:1788843465.976744:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:1.0:1788843465.976766:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c801b84-6ce8-40ad-900b-f7b60a728195+10:17382:x1875737775847424:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1788843465.976798:0:18966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843465.976828:0:18966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceea00/0xc6b8ac1b0916916 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084eae expref: -99 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.976944:0:18966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b091691d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.976963:0:18966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b091691d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.976976:0:18966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b091691d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843465.977008:0:18966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788843465.977012:0:18966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788843465.977033:0:18966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b091691d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.977065:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fceea00/0xc6b8ac1b0916916 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084eae expref: 12 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.977087:0:18966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b091691d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084eae expref: 11 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843465.977125:0:18966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8daa411aa800) 00010000:00010000:1.0:1788843465.977128:0:18966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788843465.977132:0:18966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab6fcefc00, rc 0) 00000100:00100000:1.0:1788843465.977216:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2c801b84-6ce8-40ad-900b-f7b60a728195+11:17382:x1875737775847424:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 452us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843465.977223:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:0.0:1788843465.987204:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843465.987331:0:18968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775847552 00000100:00100000:1.0:1788843465.987384:0:18968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775847552 00000100:00100000:1.0:1788843465.987462:0:18968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:1.0:1788843465.987476:0:18968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c801b84-6ce8-40ad-900b-f7b60a728195+11:17382:x1875737775847552:12345-192.168.203.29@tcp:37:lfs.0 00010000:00010000:2.0:1788843465.989457:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843465.993235:0:18968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2c801b84-6ce8-40ad-900b-f7b60a728195+11:17382:x1875737775847552:12345-192.168.203.29@tcp:37:lfs.0 Request processed in 5745us (6028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843465.993252:0:18968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:2.0:1788843466.002276:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843466.002778:0:18969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775847808 00000100:00100000:1.0:1788843466.002794:0:18969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775847808 00000100:00100000:1.0:1788843466.002894:0:18969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:1.0:1788843466.002908:0:18969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7394c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c801b84-6ce8-40ad-900b-f7b60a728195+11:17382:x1875737775847808:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:1.0:1788843466.003231:0:18969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7394c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2c801b84-6ce8-40ad-900b-f7b60a728195+12:17382:x1875737775847808:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 323us (968us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788843466.003239:0:18969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:1.0:1788843466.074070:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843466.074195:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775847936 00000100:00100000:2.0:1788843466.074209:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775847936 00000100:00100000:2.0:1788843466.074283:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:2.0:1788843466.074305:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+10:17388:x1875737775847936:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1788843466.074405:0:18967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843466.074455:0:18967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0916924 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084eb5 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.074539:0:18967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091692b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.074558:0:18967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091692b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.074572:0:18967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091692b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.074593:0:18967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916932 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.074600:0:18967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.074607:0:18967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.074986:0:18967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916939 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.074997:0:18967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916939 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.075004:0:18967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916939 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843466.075041:0:18967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788843466.075046:0:18967:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843466.075096:0:18967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916939 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.075111:0:18967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091692b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.075117:0:18967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091692b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.075124:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091692b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.075131:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843466.075136:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091692b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.075144:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091692b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.075158:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843466.075169:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843466.075175:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091692b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.075182:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091692b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.075200:0:18967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.075206:0:18967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916932 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.075212:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.075217:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375c00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843466.075220:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.075227:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916932 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.075235:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8dab54910500) 00010000:00010000:2.0:1788843466.075237:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843466.075240:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916932 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.075245:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916932 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.075281:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0916924 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084eb5 expref: 12 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.075589:0:18967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916939 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084eb5 expref: 11 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.075600:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8daa411aa800) 00010000:00010000:2.0:1788843466.075603:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788843466.075606:0:18967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375600, rc 0) 00000100:00100000:2.0:1788843466.075700:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+11:17388:x1875737775847936:12345-192.168.203.29@tcp:101:bash.0 Request processed in 1406us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843466.075718:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:3.0:1788843466.082365:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843466.082463:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775848192 00000100:00100000:0.0:1788843466.082477:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775848192 00000100:00100000:0.0:1788843466.082549:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:0.0:1788843466.082562:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+11:17388:x1875737775848192:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:0.0:1788843466.082590:0:18965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843466.082632:0:18965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697600/0xc6b8ac1b0916940 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084ebc expref: -99 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.082827:0:18965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696c00/0xc6b8ac1b0916947 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.082846:0:18965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b091691d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084eae expref: 11 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.082865:0:18965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696c00/0xc6b8ac1b0916947 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.082911:0:18965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b091691d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084eae expref: 11 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.082927:0:18965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b091691d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084eae expref: 11 pid: 18966 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843466.082943:0:18965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc1e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18965:1875737795760768:192.168.203.29@tcp:104: 00000100:00100000:0.0:1788843466.088797:0:18965:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab452ecc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843466.093828:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843466.093944:0:18950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775848320 00000100:00100000:2.0:1788843466.093957:0:18950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775848320 00010000:00010000:2.0:1788843466.094009:0:18950:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b091691d lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084eae expref: 12 pid: 18966 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843466.094071:0:18950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:2.0:1788843466.094084:0:18950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c801b84-6ce8-40ad-900b-f7b60a728195+12:2359:x1875737775848320:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843466.094104:0:18950:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843466.094113:0:18950:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b091691d lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084eae expref: 12 pid: 18966 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.094131:0:18950:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b091691d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084eae expref: 12 pid: 18966 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.094163:0:18950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8daa411aa800) 00010000:00010000:2.0:1788843466.094170:0:18950:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696c00/0xc6b8ac1b0916947 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.094199:0:18950:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696c00/0xc6b8ac1b0916947 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.094208:0:18950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696c00/0xc6b8ac1b0916947 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.094232:0:18950:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843466.094326:0:18950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c801b84-6ce8-40ad-900b-f7b60a728195+12:2359:x1875737775848320:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 233us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843466.094335:0:18950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00010000:00010000:0.0:1788843466.096104:0:18965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b091691d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084eae expref: 11 pid: 18966 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843466.096138:0:18965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc1e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18965:1875737795760768:192.168.203.29@tcp:104: 00010000:00010000:0.0:1788843466.096167:0:18965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696c00/0xc6b8ac1b0916947 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.096178:0:18965:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696c00/0xc6b8ac1b0916947 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.096204:0:18965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696c00/0xc6b8ac1b0916947 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.099733:0:18965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b091694e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.099757:0:18965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b091694e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.100875:0:18965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b091694e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.102024:0:18965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916955 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.102040:0:18965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916955 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.102050:0:18965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916955 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843466.102061:0:18965:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788843466.102089:0:18965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696c00/0xc6b8ac1b0916947 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.102096:0:18965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696c00/0xc6b8ac1b0916947 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.102103:0:18965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696c00/0xc6b8ac1b0916947 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.102109:0:18965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42696c00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843466.102122:0:18965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696c00/0xc6b8ac1b0916947 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.102131:0:18965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696c00/0xc6b8ac1b0916947 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.102144:0:18965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8daa411aa800) 00010000:00010000:0.0:1788843466.102147:0:18965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843466.102151:0:18965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696c00/0xc6b8ac1b0916947 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.102158:0:18965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696c00/0xc6b8ac1b0916947 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788843466.102173:0:18965:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075e2f60c reply state 00000000831640b0 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b091694e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843466.102182:0:18965:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788843466.102221:0:18965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697600/0xc6b8ac1b0916940 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ebc expref: 14 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.103064:0:18965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916955 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ebc expref: 13 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.103073:0:18965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8dab50f54e00) 00010000:00010000:0.0:1788843466.103075:0:18965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788843466.103077:0:18965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8daa42697000, rc 0) 00000100:00100000:0.0:1788843466.103160:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+14:17388:x1875737775848192:12345-192.168.203.29@tcp:101:bash.0 Request processed in 20599us (20830us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788843466.103170:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 28 00010000:00010000:0.0:1788843466.110414:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b091694e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.110432:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b091694e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.110440:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b091694e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.110445:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42697e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843466.110450:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b091694e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.110458:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b091694e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.110475:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8dab50f54d00) 00010000:00010000:0.0:1788843466.110479:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843466.110484:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b091694e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.110490:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b091694e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843466.127264:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843466.128001:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775848448 00000100:00100000:2.0:1788843466.128016:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775848448 00000100:00100000:2.0:1788843466.128108:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:2.0:1788843466.128120:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+13:17388:x1875737775848448:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1788843466.128146:0:18967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843466.128167:0:18967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916963 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084ec3 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.128234:0:18967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091696a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.128248:0:18967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091696a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.128260:0:18967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091696a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843466.128306:0:18967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788843466.128311:0:18967:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843466.128392:0:18967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091696a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.128406:0:18967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091696a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.128433:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916963 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ec3 expref: 15 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.128464:0:18967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091696a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ec3 expref: 14 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.128474:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8dab50f54e00) 00010000:00010000:2.0:1788843466.128476:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843466.128480:0:18967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374200, rc 0) 00000100:00100000:2.0:1788843466.128552:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+14:17388:x1875737775848448:12345-192.168.203.29@tcp:101:bash.0 Request processed in 434us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843466.128559:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:2.0:1788843466.144518:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843466.144675:0:18969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775848704 00000100:00100000:1.0:1788843466.144686:0:18969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775848704 00000100:00100000:1.0:1788843466.144755:0:18969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:1.0:1788843466.144767:0:18969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+14:17388:x1875737775848704:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:1.0:1788843466.145137:0:18969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+15:17388:x1875737775848704:12345-192.168.203.29@tcp:35:bash.0 Request processed in 371us (629us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1788843466.145145:0:18969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000040:00080000:2.0:1788843466.246121:0:18997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788843466.280269:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843466.280519:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775848960 00000100:00100000:0.0:1788843466.280533:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775848960 00000100:00100000:0.0:1788843466.280788:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:0.0:1788843466.280801:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+15:17398:x1875737775848960:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1788843466.280833:0:18965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843466.280860:0:18965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b0916971 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084eca expref: -99 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843466.281007:0:18965:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788843466.281167:0:18965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b0916971 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084eca expref: 17 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.281184:0:18965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:0.0:1788843466.281188:0:18965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788843466.281193:0:18965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b0916971 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084eca expref: 17 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.281211:0:18965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8daa42697e00, rc 0) 00000100:00100000:0.0:1788843466.281302:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+16:17398:x1875737775848960:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 503us (1049us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1788843466.281310:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:3.0:1788843466.290779:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843466.291163:0:18969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775849216 00000100:00100000:1.0:1788843466.291176:0:18969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775849216 00000100:00100000:1.0:1788843466.291260:0:18969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:1.0:1788843466.291273:0:18969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+16:17398:x1875737775849216:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:1.0:1788843466.291656:0:18969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+17:17398:x1875737775849216:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 384us (889us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1788843466.291664:0:18969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:3.0:1788843466.338993:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843466.339162:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775849472 00000100:00100000:1.0:1788843466.339176:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775849472 00000100:00100000:1.0:1788843466.339256:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:1.0:1788843466.339269:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+17:17401:x1875737775849472:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1788843466.339311:0:18966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843466.339384:0:18966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee200/0xc6b8ac1b091697f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084ed1 expref: -99 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843466.339521:0:18966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee800/0xc6b8ac1b0916986 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843466.339538:0:18966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee800/0xc6b8ac1b0916986 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843466.339550:0:18966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee800/0xc6b8ac1b0916986 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843466.339592:0:18966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788843466.339770:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee200/0xc6b8ac1b091697f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ed1 expref: 20 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843466.339793:0:18966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee800/0xc6b8ac1b0916986 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ed1 expref: 19 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843466.339803:0:18966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8dab50f54e00) 00010000:00010000:1.0:1788843466.339806:0:18966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788843466.339811:0:18966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab6fcee800, rc 0) 00000100:00100000:1.0:1788843466.339900:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+19:17401:x1875737775849472:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 634us (923us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1788843466.339908:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:3.0:1788843466.345470:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843466.345637:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775849600 00000100:00100000:0.0:1788843466.345649:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775849600 00000100:00100000:0.0:1788843466.345825:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:0.0:1788843466.345840:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+19:17401:x1875737775849600:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:0.0:1788843466.345935:0:18965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b0916994 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.345957:0:18965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b0916994 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.345970:0:18965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b0916994 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.346004:0:18965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b0916994 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.346030:0:18965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b0916994 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.346038:0:18965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b0916994 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.346045:0:18965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42697e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843466.346050:0:18965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b0916994 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.346059:0:18965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b0916994 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.346075:0:18965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8dab50f54e00) 00010000:00010000:0.0:1788843466.346078:0:18965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788843466.346084:0:18965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b0916994 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.346091:0:18965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b0916994 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843466.346294:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+19:17401:x1875737775849600:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 448us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843466.346304:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:3.0:1788843466.350431:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843466.350748:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775849728 00000100:00100000:2.0:1788843466.350761:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775849728 00000100:00100000:2.0:1788843466.350849:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:2.0:1788843466.350871:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c183480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+19:2358:x1875737775849728:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843466.350891:0:18951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843466.350924:0:18951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee800/0xc6b8ac1b0916986 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ed1 expref: 19 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.350950:0:18951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8dab50f54e00) 00010000:00010000:2.0:1788843466.350975:0:18951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843466.351054:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c183480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+18:2358:x1875737775849728:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 185us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843466.351064:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:3.0:1788843466.367057:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843466.367237:0:18969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775849984 00000100:00100000:1.0:1788843466.367251:0:18969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775849984 00000100:00100000:1.0:1788843466.367336:0:18969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:1.0:1788843466.367381:0:18969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+18:17401:x1875737775849984:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:1.0:1788843466.367706:0:18969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+19:17401:x1875737775849984:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 327us (661us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1788843466.367715:0:18969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:0.0:1788843466.652502:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843466.652623:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775850240 00000100:00100000:1.0:1788843466.652636:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775850240 00000100:00100000:1.0:1788843466.652720:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:1.0:1788843466.652732:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+19:17432:x1875737775850240:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:1.0:1788843466.652764:0:18966:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843466.652809:0:18966:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee200/0xc6b8ac1b091699b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084ed8 expref: -99 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843466.652958:0:18966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef200/0xc6b8ac1b09169a2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843466.652977:0:18966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef200/0xc6b8ac1b09169a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843466.652990:0:18966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef200/0xc6b8ac1b09169a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843466.653003:0:18966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788843466.653183:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee200/0xc6b8ac1b091699b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ed8 expref: 22 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843466.653207:0:18966:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef200/0xc6b8ac1b09169a2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ed8 expref: 21 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843466.653216:0:18966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8dab50f54e00) 00010000:00010000:1.0:1788843466.653220:0:18966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788843466.653223:0:18966:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab6fcef200, rc 0) 00000100:00100000:1.0:1788843466.653312:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+21:17432:x1875737775850240:12345-192.168.203.29@tcp:101:cat.0 Request processed in 582us (825us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1788843466.653320:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:3.0:1788843466.658092:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843466.658156:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843466.658255:0:18969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775850496 00000100:00100000:1.0:1788843466.658268:0:18969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775850496 00000100:00100000:1.0:1788843466.658386:0:18969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:1.0:1788843466.658399:0:18969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+21:17432:x1875737775850496:12345-192.168.203.29@tcp:35:cat.0 00000100:00100000:1.0:1788843466.658884:0:18969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+22:17432:x1875737775850496:12345-192.168.203.29@tcp:35:cat.0 Request processed in 485us (807us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1788843466.658894:0:18969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:0.0:1788843466.659089:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775850624 00000100:00100000:0.0:1788843466.659096:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775850624 00000100:00100000:0.0:1788843466.659151:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:0.0:1788843466.659159:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c180a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+22:2359:x1875737775850624:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843466.659184:0:18952:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843466.659213:0:18952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcef200/0xc6b8ac1b09169a2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ed8 expref: 22 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.659233:0:18952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8dab50f54e00) 00010000:00010000:0.0:1788843466.659238:0:18952:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843466.659261:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c180a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+21:2359:x1875737775850624:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 103us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843466.659267:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:3.0:1788843466.714490:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843466.714626:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775850880 00000100:00100000:2.0:1788843466.714640:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775850880 00000100:00100000:2.0:1788843466.714726:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:2.0:1788843466.714739:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+21:17438:x1875737775850880:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:2.0:1788843466.714773:0:18967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843466.714801:0:18967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09169b0 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084edf expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.714943:0:18967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09169b7 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.714963:0:18967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916955 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ebc expref: 22 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.714973:0:18967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091696a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ec3 expref: 22 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.714983:0:18967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09169b7 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.715028:0:18967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091696a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ec3 expref: 22 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.715044:0:18967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091696a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ec3 expref: 22 pid: 18967 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843466.715085:0:18967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18967:1875737795760896:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843466.715208:0:18967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916955 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ebc expref: 22 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.715218:0:18967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916955 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ebc expref: 22 pid: 18965 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843466.715228:0:18967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a78000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18967:1875737795761024:192.168.203.29@tcp:104: 00000100:00100000:2.0:1788843466.715253:0:18967:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab49368900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843466.719152:0:18967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18967:1875737795760896:192.168.203.29@tcp:104: 00000100:00100000:2.0:1788843466.719173:0:18967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a78000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18967:1875737795761024:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843466.719208:0:18967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09169b7 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843466.720979:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843466.721032:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843466.721242:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775851008 00000100:00100000:0.0:1788843466.721253:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775851008 00010000:00010000:0.0:1788843466.721323:0:18952:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091696a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ec3 expref: 23 pid: 18967 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843466.721404:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775851136 00000100:00100000:0.0:1788843466.721407:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775851136 00010000:00010000:0.0:1788843466.721421:0:18952:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916955 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ebc expref: 24 pid: 18965 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843466.721438:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:0.0:1788843466.721447:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+24:2358:x1875737775851008:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843466.721464:0:18952:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843466.721471:0:18952:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091696a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ec3 expref: 24 pid: 18967 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.721486:0:18952:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091696a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ec3 expref: 24 pid: 18967 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.721533:0:18952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b091696a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ec3 expref: 24 pid: 18967 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.721552:0:18952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8dab50f54e00) 00010000:00010000:0.0:1788843466.721557:0:18952:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09169b7 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.721567:0:18952:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09169b7 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.721574:0:18952:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843466.721644:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+23:2358:x1875737775851008:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 197us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843466.721652:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:0.0:1788843466.721726:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:0.0:1788843466.721733:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c180e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+22:2359:x1875737775851136:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843466.721741:0:18952:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843466.721746:0:18952:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916955 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ebc expref: 22 pid: 18965 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.721755:0:18952:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916955 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ebc expref: 22 pid: 18965 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.721768:0:18952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916955 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ebc expref: 22 pid: 18965 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.721791:0:18952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8dab50f54e00) 00010000:00010000:0.0:1788843466.721795:0:18952:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09169b7 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.721805:0:18952:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09169b7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.721814:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09169b7 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.721842:0:18952:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843466.721863:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c180e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+21:2359:x1875737775851136:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 130us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843466.721870:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00010000:00010000:2.0:1788843466.722820:0:18967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09169b7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.722834:0:18967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09169b7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843466.722867:0:18967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788843466.723090:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09169b0 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084edf expref: 22 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.723111:0:18967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09169b7 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084edf expref: 21 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.723131:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8dab50f54e00) 00010000:00010000:2.0:1788843466.723134:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788843466.723137:0:18967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375400, rc 0) 00000100:00100000:2.0:1788843466.723205:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+21:17438:x1875737775850880:12345-192.168.203.29@tcp:101:dd.0 Request processed in 8467us (8728us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1788843466.723214:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:3.0:1788843466.728254:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843466.728402:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775851392 00000100:00100000:0.0:1788843466.728416:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775851392 00000100:00100000:0.0:1788843466.728492:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:0.0:1788843466.728504:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+21:17438:x1875737775851392:12345-192.168.203.29@tcp:36:dd.0 00010000:00010000:0.0:1788843466.728888:0:18965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b09169c5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.728911:0:18965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b09169c5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.728925:0:18965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b09169c5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843466.728982:0:18965:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1788843466.729007:0:18965:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5f7e88f reply state 00000000909b85c5 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b09169c5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843466.729028:0:18965:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788843466.729149:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+24:17438:x1875737775851392:12345-192.168.203.29@tcp:36:dd.0 Request processed in 646us (908us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1788843466.729157:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 35 00000020:00080000:0.0:1788843466.729162:0:18965:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788843466.731964:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b09169c5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.731984:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b09169c5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.731992:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b09169c5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.731998:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42697000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843466.732003:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b09169c5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.732011:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b09169c5 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.732031:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8dab50f54e00) 00010000:00010000:2.0:1788843466.732034:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843466.732038:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b09169c5 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.732044:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b09169c5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843466.733770:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843466.733872:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775851520 00000100:00100000:2.0:1788843466.733884:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775851520 00000100:00100000:2.0:1788843466.733956:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:2.0:1788843466.733968:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+23:17438:x1875737775851520:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:2.0:1788843466.733999:0:18967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843466.734025:0:18967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09169cc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084ee6 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.734104:0:18967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09169cc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ee6 expref: 24 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.734122:0:18967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09169cc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ee6 expref: 24 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843466.734145:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8dab50f54e00) 00010000:00010000:2.0:1788843466.734149:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788843466.734152:0:18967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375c00, rc 0) 00000100:00100000:2.0:1788843466.734230:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+24:17438:x1875737775851520:12345-192.168.203.29@tcp:101:dd.0 Request processed in 264us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843466.734238:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:3.0:1788843466.748937:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843466.749109:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775851776 00000100:00100000:0.0:1788843466.749122:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775851776 00000100:00100000:0.0:1788843466.749210:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:0.0:1788843466.749224:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+24:17438:x1875737775851776:12345-192.168.203.29@tcp:103:dd.0 00010000:00010000:0.0:1788843466.749246:0:18952:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843466.749280:0:18952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09169cc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ee6 expref: 24 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.749318:0:18952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8dab50f54e00) 00010000:00010000:0.0:1788843466.749324:0:18952:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843466.749467:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+23:17438:x1875737775851776:12345-192.168.203.29@tcp:103:dd.0 Request processed in 246us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843466.749476:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:3.0:1788843466.755249:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843466.755385:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775851904 00000100:00100000:1.0:1788843466.755397:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775851904 00000100:00100000:1.0:1788843466.755475:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:1.0:1788843466.755486:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+23:17438:x1875737775851904:12345-192.168.203.29@tcp:58:dd.0 00010000:00010000:1.0:1788843466.755614:0:18966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee200/0xc6b8ac1b09169d3 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843466.755636:0:18966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee200/0xc6b8ac1b09169d3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843466.755652:0:18966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee200/0xc6b8ac1b09169d3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788843466.756623:0:18966:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843466.756806:0:18966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1788843466.756892:0:18966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1788843466.757029:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+23:17438:x1875737775851904:12345-192.168.203.29@tcp:58:dd.0 Request processed in 1538us (1789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843466.757040:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:3.0:1788843466.759941:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843466.760073:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775852032 00000100:00100000:0.0:1788843466.760086:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775852032 00000100:00100000:0.0:1788843466.760157:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 38 00000100:00100000:0.0:1788843466.760169:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+23:17438:x1875737775852032:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:0.0:1788843466.760195:0:18965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843466.760222:0:18965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b09169da lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084eed expref: -99 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.760335:0:18965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee200/0xc6b8ac1b09169d3 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.760373:0:18965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b09169da lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084eed expref: 24 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.760397:0:18965:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee200/0xc6b8ac1b09169d3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.760412:0:18965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b09169da lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084eed expref: 24 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.760429:0:18965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8dab50f54e00) 00010000:00010000:0.0:1788843466.760432:0:18965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788843466.760437:0:18965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b09169da lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084eed expref: 24 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843466.760445:0:18965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8daa42697e00, rc 0) 00000100:00100000:0.0:1788843466.760528:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+24:17438:x1875737775852032:12345-192.168.203.29@tcp:101:dd.0 Request processed in 361us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843466.760537:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 38 00010000:00010000:2.0:1788843467.013007:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788843467.268728:0:18997:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788843467.268741:0:18997:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788843467.268818:0:18997:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788843467.268826:0:18997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788843467.268990:0:18997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a78000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18997:1875737795761152:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788843467.269172:0:18997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab61d99180 going to sleep for 11 seconds 00000100:00100000:3.0:1788843467.274037:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843467.274430:0:18997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a78000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18997:1875737795761152:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788843467.276548:0:18976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775852160 00000100:00100000:0.0:1788843467.276567:0:18976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775852160 00000100:00100000:0.0:1788843467.276676:0:18976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:0.0:1788843467.276692:0:18976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f626edf3-537d-4eb9-9825-d3d39a257fe8+24:17439:x1875737775852160:12345-192.168.203.29@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788843467.276813:0:18976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f626edf3-537d-4eb9-9825-d3d39a257fe8+24:17439:x1875737775852160:12345-192.168.203.29@tcp:900:lhsmtool_posix.0 Request processed in 126us (2791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843467.276841:0:18976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00080000:3.0:1788843467.278051:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843467.285670:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843467.285810:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775852288 00000100:00100000:2.0:1788843467.285823:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775852288 00000100:00100000:2.0:1788843467.285912:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:2.0:1788843467.285925:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+24:17439:x1875737775852288:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788843467.285967:0:18967:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788843467.286720:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+24:17439:x1875737775852288:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 791us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843467.286731:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:1.0:1788843467.301127:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843467.301303:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775852416 00000100:00100000:3.0:1788843467.301316:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775852416 00000100:00100000:3.0:1788843467.301434:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:3.0:1788843467.301446:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+24:17439:x1875737775852416:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788843467.301543:0:18966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09169e1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.301565:0:18966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09169e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.301578:0:18966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09169e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304047:0:18966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09169e8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304071:0:18966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09169e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304096:0:18966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09169e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304129:0:18966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09169ef lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304150:0:18966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09169ef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304157:0:18966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09169ef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843467.304200:0:18966:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788843467.304204:0:18966:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788843467.304221:0:18966:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09169ef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304233:0:18966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09169e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304239:0:18966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09169e1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304245:0:18966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09169e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304251:0:18966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843467.304255:0:18966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09169e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304263:0:18966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09169e1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304291:0:18966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dab50f54900) 00010000:00010000:3.0:1788843467.304294:0:18966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843467.304300:0:18966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09169e1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304307:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09169e1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304327:0:18966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09169e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304335:0:18966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09169e8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304379:0:18966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09169e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304386:0:18966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843467.304398:0:18966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09169e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304405:0:18966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09169e8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304413:0:18966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8dab43e63200) 00010000:00010000:3.0:1788843467.304415:0:18966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843467.304417:0:18966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09169e8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304422:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09169e8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304451:0:18966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09169ef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304457:0:18966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09169ef lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.304462:0:18966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09169ef lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.305920:0:18966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843467.305927:0:18966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09169ef lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.305937:0:18966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09169ef lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.305952:0:18966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8dab50f54e00) 00010000:00010000:3.0:1788843467.305956:0:18966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843467.305960:0:18966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09169ef lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.305966:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09169ef lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843467.306086:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+24:17439:x1875737775852416:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 Request processed in 4639us (4969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843467.306097:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:3.0:1788843467.308552:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843467.309031:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775852672 00000100:00100000:2.0:1788843467.309044:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775852672 00000100:00100000:2.0:1788843467.309119:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:2.0:1788843467.309131:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+24:17439:x1875737775852672:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843467.309159:0:18967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843467.309188:0:18967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b09169f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084ef4 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.309331:0:18967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b09169fd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.309376:0:18967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b09169fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.309391:0:18967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b09169fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843467.309405:0:18967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788843467.309569:0:18967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b09169fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.309579:0:18967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b09169fd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.309586:0:18967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b09169fd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.309594:0:18967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843467.309598:0:18967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b09169fd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.309608:0:18967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b09169fd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.309623:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8dab50f54e00) 00010000:00010000:2.0:1788843467.309627:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788843467.309633:0:18967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b09169fd lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.309639:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b09169fd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.309689:0:18967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b09169f6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ef4 expref: 26 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.309701:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dab50f54900) 00010000:00010000:2.0:1788843467.309703:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788843467.309707:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b09169f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ef4 expref: 26 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.309729:0:18967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375a00, rc 0) 00000100:00100000:2.0:1788843467.312833:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+25:17439:x1875737775852672:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 3684us (4277us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1788843467.313038:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:0.0:1788843467.325479:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843467.326076:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775852800 00000100:00100000:3.0:1788843467.326093:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775852800 00000100:00100000:3.0:1788843467.326187:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:3.0:1788843467.326199:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+25:17439:x1875737775852800:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788843467.326246:0:18966:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788843467.326965:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+25:17439:x1875737775852800:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 759us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843467.326976:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:1.0:1788843467.330950:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843467.331062:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775853056 00000100:00100000:2.0:1788843467.331076:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775853056 00000100:00100000:2.0:1788843467.331141:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:2.0:1788843467.331152:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+25:17439:x1875737775853056:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843467.331180:0:18967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843467.331206:0:18967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0916a0b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084efb expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788843467.332575:0:18967:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x23:0x0], count =31 00000004:00080000:2.0:1788843467.332588:0:18967:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x23:0x0]+31 in llog 00000004:00080000:2.0:1788843467.332647:0:18967:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42:0x0], index 0: 0 00010000:00010000:2.0:1788843467.333558:0:18967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b0916a12 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.333582:0:18967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b0916a12 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.333597:0:18967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b0916a12 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.333675:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0916a0b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084efb expref: 28 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.333775:0:18967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b0916a12 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084efb expref: 27 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.333786:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8dab54910500) 00010000:00010000:2.0:1788843467.333790:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843467.333795:0:18967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375e00, rc 0) 00000100:00100000:2.0:1788843467.334043:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+27:17439:x1875737775853056:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 2890us (3104us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1788843467.334053:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:2.0:1788843467.339628:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843467.339799:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775853312 00000100:00100000:3.0:1788843467.339811:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775853312 00000100:00100000:3.0:1788843467.339885:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:3.0:1788843467.339897:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+27:17439:x1875737775853312:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788843467.339977:0:18966:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843467.340009:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b0916a12 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084efb expref: 27 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.340032:0:18966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8dab54910500) 00010000:00010000:3.0:1788843467.340300:0:18966:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843467.340336:0:18966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0916a20 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.340533:0:18966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0916a20 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.340545:0:18966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0916a20 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.340563:0:18966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a27 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb95f38d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.340570:0:18966:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a27 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb95f38d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.340595:0:18966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a27 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb95f38d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.340681:0:18966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0916a20 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.340689:0:18966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0916a20 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.340707:0:18966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0916a20 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.340715:0:18966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843467.340721:0:18966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0916a20 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.340730:0:18966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0916a20 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.340740:0:18966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8daa411aa800) 00010000:00010000:3.0:1788843467.340742:0:18966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843467.340748:0:18966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0916a20 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.340754:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0916a20 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.340770:0:18966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a27 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb95f38d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.340777:0:18966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a27 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb95f38d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.340790:0:18966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a27 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb95f38d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.340795:0:18966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843467.340798:0:18966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a27 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb95f38d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.340805:0:18966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a27 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb95f38d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.340813:0:18966:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb95f38d3 (ffff8dab43e63200) 00010000:00010000:3.0:1788843467.340815:0:18966:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843467.340818:0:18966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a27 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb95f38d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.340822:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a27 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb95f38d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843467.340958:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+26:17439:x1875737775853312:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 1059us (1340us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788843467.340967:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:0.0:1788843467.343978:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843467.344301:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775853440 00000100:00100000:3.0:1788843467.344313:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775853440 00000100:00100000:3.0:1788843467.344415:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:3.0:1788843467.344428:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+26:17439:x1875737775853440:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843467.344455:0:18967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843467.344483:0:18967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0916a2e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084f02 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.344654:0:18967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0916a35 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.344672:0:18967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0916a35 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.344686:0:18967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0916a35 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.345191:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0916a2e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084f02 expref: 28 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.345221:0:18967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0916a35 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084f02 expref: 27 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.345231:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:0.0:1788843467.345235:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788843467.345238:0:18967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82054e00, rc 0) 00000100:00100000:0.0:1788843467.345442:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+27:17439:x1875737775853440:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 1015us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843467.345450:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:1.0:1788843467.349721:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843467.349800:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775853696 00000100:00100000:0.0:1788843467.349813:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775853696 00000100:00100000:0.0:1788843467.349896:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:0.0:1788843467.349907:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+27:17439:x1875737775853696:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788843467.350009:0:18965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916a3c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.350033:0:18965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916a3c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.350047:0:18965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916a3c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788843467.350651:0:18965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1788843467.350665:0:18965:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 591601322847ns, next at 592601320119ns, rc = 0 00000004:00010000:0.0:1788843467.350774:0:18965:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5672a8c reply state 00000000d203056d transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916a3c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843467.350785:0:18965:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788843467.350908:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+29:17439:x1875737775853696:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 1001us (1198us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1788843467.350917:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 46 00010000:00010000:0.0:1788843467.353869:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916a3c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.353892:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916a3c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.353902:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916a3c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.353909:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42696a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843467.353915:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916a3c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.353925:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916a3c lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.353947:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:0.0:1788843467.353951:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788843467.353957:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916a3c lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.353989:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916a3c lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843467.355498:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843467.355968:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775853824 00000100:00100000:0.0:1788843467.355982:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775853824 00000100:00100000:0.0:1788843467.356057:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:0.0:1788843467.356070:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+28:17439:x1875737775853824:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843467.356101:0:18967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843467.356129:0:18967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b0916a43 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084f09 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.356208:0:18967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b0916a43 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084f09 expref: 29 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.356224:0:18967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b0916a43 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084f09 expref: 29 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.356245:0:18967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:0.0:1788843467.356249:0:18967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788843467.356253:0:18967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8daa42696400, rc 0) 00000100:00100000:0.0:1788843467.356380:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+29:17439:x1875737775853824:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 311us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843467.356389:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:2.0:1788843467.360221:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843467.360313:0:19650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775853952 00000100:00100000:0.0:1788843467.360326:0:19650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775853952 00000100:00100000:0.0:1788843467.360444:0:19650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:0.0:1788843467.360455:0:19650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+5:2358:x1875737775853952:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788843467.360731:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843467.361478:0:19650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+6:2358:x1875737775853952:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 880us (1129us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788843467.361492:0:19650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:1.0:1788843467.364121:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843467.364236:0:18969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775854208 00000100:00100000:3.0:1788843467.364248:0:18969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775854208 00000100:00100000:3.0:1788843467.364335:0:18969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:3.0:1788843467.364381:0:18969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+29:17439:x1875737775854208:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788843467.364809:0:18969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+30:17439:x1875737775854208:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 429us (700us total) trans 12884901910 rc 0/0 00000100:00100000:3.0:1788843467.364818:0:18969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:1.0:1788843467.367594:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843467.367893:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775854464 00000100:00100000:3.0:1788843467.367905:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775854464 00000100:00100000:3.0:1788843467.367968:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:3.0:1788843467.367979:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+30:17439:x1875737775854464:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788843467.368116:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+30:17439:x1875737775854464:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 138us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843467.368125:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:0.0:1788843467.374428:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843467.374531:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775854592 00000100:00100000:3.0:1788843467.374544:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775854592 00000100:00100000:3.0:1788843467.374640:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:3.0:1788843467.374653:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+30:17439:x1875737775854592:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843467.374684:0:18965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843467.374729:0:18965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a4a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084f10 expref: -99 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.374832:0:18965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0916a51 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.374861:0:18965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0916a51 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.374875:0:18965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0916a51 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843467.374924:0:18965:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788843467.374947:0:18965:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0916a51 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.374976:0:18965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a4a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084f10 expref: 32 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.375001:0:18965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0916a51 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084f10 expref: 31 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.375011:0:18965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:3.0:1788843467.375015:0:18965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788843467.375019:0:18965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82055800, rc 0) 00000100:00100000:3.0:1788843467.375101:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+31:17439:x1875737775854592:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 451us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843467.375119:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:1.0:1788843467.379483:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843467.383637:0:20132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775854720 00000100:00100000:0.0:1788843467.383656:0:20132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775854720 00000100:00100000:0.0:1788843467.383762:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:0.0:1788843467.383774:0:20132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f626edf3-537d-4eb9-9825-d3d39a257fe8+6:2358:x1875737775854720:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843467.383797:0:20132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843467.383826:0:20132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000810bdb76/0xc6b8ac1b0916a58 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084f17 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843467.383869:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f95cb, blocks: 0x1 00010000:00010000:0.0:1788843467.383895:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=591s v=(0 0) 00010000:00010000:0.0:1788843467.383901:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843467.383913:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000810bdb76/0xc6b8ac1b0916a58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084f17 expref: 7 pid: 20132 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.383937:0:20132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000810bdb76/0xc6b8ac1b0916a58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084f17 expref: 7 pid: 20132 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.383954:0:20132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8daa42697000, rc 0) 00000100:00100000:0.0:1788843467.384053:0:20132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f626edf3-537d-4eb9-9825-d3d39a257fe8+7:2358:x1875737775854720:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 271us (4575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843467.384063:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:0.0:1788843467.387447:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843467.387567:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775854976 00000100:00100000:2.0:1788843467.387580:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775854976 00000100:00100000:2.0:1788843467.387649:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:2.0:1788843467.387661:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+31:17439:x1875737775854976:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788843467.387817:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f626edf3-537d-4eb9-9825-d3d39a257fe8+31:17439:x1875737775854976:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 157us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843467.387826:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:3.0:1788843467.390546:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843467.390652:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775855104 00000100:00100000:1.0:1788843467.390664:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775855104 00000100:00100000:1.0:1788843467.390746:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:1.0:1788843467.390758:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+31:17439:x1875737775855104:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788843467.409062:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843467.409105:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843467.409129:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843467.409155:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843467.409182:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843467.409324:0:18965:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788843467.409336:0:18965:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788843467.410363:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775855232 00000100:00100000:0.0:1788843467.410379:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775855232 00000100:00100000:0.0:1788843467.410449:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 121 00000100:00100000:0.0:1788843467.410460:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+13:2356:x1875737775855232:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843467.410563:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e27f4f77-381a-4316-945d-346e72200308+13:2356:x1875737775855232:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 104us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843467.410572:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 121 00000100:00100000:0.0:1788843467.410615:0:19650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775855744 00000100:00100000:0.0:1788843467.410620:0:19650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775855744 00000100:00100000:0.0:1788843467.410659:0:19650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775855360 00000100:00100000:0.0:1788843467.410663:0:19650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775855360 00000100:00100000:0.0:1788843467.410677:0:19650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775855616 00000100:00100000:0.0:1788843467.410680:0:19650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775855616 00000100:00100000:0.0:1788843467.410706:0:19650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:0.0:1788843467.410713:0:19650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c801b84-6ce8-40ad-900b-f7b60a728195+5:2356:x1875737775855744:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843467.410744:0:19650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c801b84-6ce8-40ad-900b-f7b60a728195+5:2356:x1875737775855744:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 32us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843467.410751:0:19650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:0.0:1788843467.410763:0:19650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:0.0:1788843467.410769:0:19650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+5:2356:x1875737775855360:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843467.410793:0:19650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+5:2356:x1875737775855360:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 24us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843467.410798:0:19650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:0.0:1788843467.410809:0:19650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:0.0:1788843467.410816:0:19650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c801b84-6ce8-40ad-900b-f7b60a728195+5:2356:x1875737775855616:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843467.411321:0:19650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2c801b84-6ce8-40ad-900b-f7b60a728195+5:2356:x1875737775855616:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 502us (2134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843467.411329:0:19650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:3.0:1788843467.412548:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775855488 00000100:00100000:3.0:1788843467.412561:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775855488 00000100:00100000:3.0:1788843467.412620:0:18965:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788843467.412635:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:3.0:1788843467.412643:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c801b84-6ce8-40ad-900b-f7b60a728195+11:2356:x1875737775855488:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843467.412728:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2c801b84-6ce8-40ad-900b-f7b60a728195+11:2356:x1875737775855488:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 85us (3621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843467.412736:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00080000:0.0:1788843467.413062:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788843467.413068:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788843467.413071:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843467.445571:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+31:17439:x1875737775855104:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 Request processed in 54798us (55021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843467.445588:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:3.0:1788843467.447973:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843467.448087:0:20132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775855872 00000100:00100000:2.0:1788843467.448099:0:20132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775855872 00000100:00100000:2.0:1788843467.448167:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:2.0:1788843467.448177:0:20132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f626edf3-537d-4eb9-9825-d3d39a257fe8+7:2358:x1875737775855872:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788843467.448311:0:20132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f626edf3-537d-4eb9-9825-d3d39a257fe8+7:2358:x1875737775855872:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 Request processed in 135us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843467.448372:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00000001:00080000:0.0:1788843467.450268:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901909 is committed 00000004:00080000:0.0:1788843467.450293:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788843467.450387:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000001:00080000:0.0:1788843467.450418:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000100:00100000:2.0:1788843467.450650:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843467.450674:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795761280:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788843467.450767:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843467.451051:0:19652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795761280 00000100:00100000:2.0:1788843467.451060:0:19652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795761280 00000100:00100000:2.0:1788843467.451131:0:19652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843467.451141:0:19652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795761280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788843467.451337:0:19652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788843467.451369:0:19652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788843467.451372:0:19652:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788843467.451374:0:19652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788843467 -> 1788843467 00002000:00010000:2.0:1788843467.451376:0:19652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788843467.451427:0:19652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1875737795761280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 287us (660us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1788843467.451435:0:19652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1788843467.451488:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dab73a7b100/2, rc 0, transno 12884901891 00000100:00100000:2.0:1788843467.451495:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795761280:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1788843467.451552:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843467.452139:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843467.452228:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775856128 00000100:00100000:3.0:1788843467.452236:0:18965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775856128 00000100:00100000:3.0:1788843467.452327:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:3.0:1788843467.452338:0:18965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+14:17439:x1875737775856128:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788843467.452480:0:18965:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843467.452528:0:18965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0916a51 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084f10 expref: 14 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.452555:0:18965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:3.0:1788843467.452561:0:18965:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843467.452597:0:18965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a5f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.452613:0:18965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a5f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.452625:0:18965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a5f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843467.453068:0:18965:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e4e0445 reply state 00000000af8fcb9b transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a5f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843467.453080:0:18965:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788843467.453242:0:18965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+15:17439:x1875737775856128:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 906us (1106us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1788843467.453250:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:2.0:1788843467.456329:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843467.456990:0:20132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775856256 00000100:00100000:3.0:1788843467.457004:0:20132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775856256 00000100:00100000:3.0:1788843467.457075:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:3.0:1788843467.457085:0:20132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f626edf3-537d-4eb9-9825-d3d39a257fe8+7:2359:x1875737775856256:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788843467.457368:0:20132:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788843467.457373:0:20132:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1788843466 00002000:00010000:3.0:1788843467.457375:0:20132:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 1788843466 00002000:00010000:3.0:1788843467.457378:0:20132:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788843467 -> 1788843466 00002000:00010000:3.0:1788843467.457398:0:20132:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788843467.457475:0:20132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f626edf3-537d-4eb9-9825-d3d39a257fe8+8:2359:x1875737775856256:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 389us (1157us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788843467.457484:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00010000:00010000:1.0:1788843467.462232:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a5f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.462257:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a5f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.462266:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a5f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.462274:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843467.462291:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a5f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.462301:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a5f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.462325:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:1.0:1788843467.462329:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843467.462335:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a5f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.462355:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0916a5f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843467.462779:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843467.462857:0:19651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775856384 00000100:00100000:2.0:1788843467.462868:0:19651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775856384 00000100:00100000:2.0:1788843467.462936:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:2.0:1788843467.462948:0:19651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+8:2359:x1875737775856384:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788843467.463001:0:19651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004081ca72/0xc6b8ac1b0916a66 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.463033:0:19651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843467.463037:0:19651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843467.463044:0:19651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004081ca72/0xc6b8ac1b0916a66 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.463059:0:19651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004081ca72/0xc6b8ac1b0916a66 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.463096:0:19651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004081ca72/0xc6b8ac1b0916a66 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.463105:0:19651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004081ca72/0xc6b8ac1b0916a66 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.463113:0:19651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004081ca72/0xc6b8ac1b0916a66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.463121:0:19651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843467.463125:0:19651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004081ca72/0xc6b8ac1b0916a66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.463134:0:19651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004081ca72/0xc6b8ac1b0916a66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.463146:0:19651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004081ca72/0xc6b8ac1b0916a66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.463163:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004081ca72/0xc6b8ac1b0916a66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843467.463258:0:19651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+8:2359:x1875737775856384:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 Request processed in 312us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843467.463267:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:3.0:1788843467.465966:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843467.466068:0:21100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775856640 00000100:00100000:1.0:1788843467.466096:0:21100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775856640 00000100:00100000:1.0:1788843467.466164:0:21100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:1.0:1788843467.466176:0:21100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f626edf3-537d-4eb9-9825-d3d39a257fe8+14:17439:x1875737775856640:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788843467.466292:0:21100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee800/0xc6b8ac1b0916a6d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.466316:0:21100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee800/0xc6b8ac1b0916a6d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.466330:0:21100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee800/0xc6b8ac1b0916a6d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.466674:0:21100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b0916a74 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.466688:0:21100:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b0916a43 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084f09 expref: 15 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.466696:0:21100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b0916a74 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.466739:0:21100:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b0916a43 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084f09 expref: 15 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.466755:0:21100:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b0916a43 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084f09 expref: 15 pid: 18967 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843467.466772:0:21100:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:21100:1875737795761408:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843467.466873:0:21100:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4aa1eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843467.469444:0:21100:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:21100:1875737795761408:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843467.469485:0:21100:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b0916a74 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843467.471426:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843467.471698:0:18950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775856768 00000100:00100000:2.0:1788843467.471711:0:18950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775856768 00010000:00010000:2.0:1788843467.471770:0:18950:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b0916a43 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084f09 expref: 16 pid: 18967 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843467.471819:0:18950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:2.0:1788843467.471831:0:18950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+16:2358:x1875737775856768:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843467.471863:0:18950:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843467.471872:0:18950:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b0916a43 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084f09 expref: 16 pid: 18967 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.471886:0:18950:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b0916a43 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084f09 expref: 16 pid: 18967 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.471913:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b0916a43 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084f09 expref: 16 pid: 18967 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.471935:0:18950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:2.0:1788843467.471942:0:18950:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b0916a74 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.471969:0:18950:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b0916a74 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.471979:0:18950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b0916a74 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.472015:0:18950:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843467.472082:0:18950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+15:2358:x1875737775856768:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 253us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843467.472091:0:18950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00010000:00010000:1.0:1788843467.472304:0:21100:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b0916a74 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.472321:0:21100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b0916a74 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788843467.472605:0:21100:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:1.0:1788843467.472796:0:21100:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:1.0:1788843467.472865:0:21100:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:1.0:1788843467.472972:0:21100:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:21100:1875737795761536:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788843467.480117:0:21100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843467.480248:0:18970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795761536 00000100:00100000:3.0:1788843467.480265:0:18970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795761536 00000100:00100000:3.0:1788843467.480380:0:18970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843467.480393:0:18970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21100:x1875737795761536:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788843467.480574:0:18970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21100:x1875737795761536:12345-0@lo:1000:mdt00_003.0 Request processed in 184us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843467.480583:0:18970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843467.480703:0:21100:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4aa1e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843467.480744:0:21100:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:21100:1875737795761536:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788843467.482002:0:21100:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:2.0:1788843467.482117:0:21100:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6eb29880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:21100:1875737795761664:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788843467.482188:0:21100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843467.482317:0:21100:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7c15f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788843467.485914:0:18970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795761664 00000100:00100000:0.0:1788843467.485936:0:18970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795761664 00000100:00100000:0.0:1788843467.486020:0:18970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843467.486034:0:18970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21100:x1875737795761664:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788843467.486429:0:18970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:21100:x1875737795761664:12345-0@lo:1000:mdt00_003.0 Request processed in 398us (4239us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788843467.486439:0:18970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843467.486768:0:21100:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6eb29880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:21100:1875737795761664:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788843467.486828:0:21100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b0916a74 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.486950:0:21100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b0916a74 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.486960:0:21100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b0916a74 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.486967:0:21100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcefc00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843467.486992:0:21100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b0916a74 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.487001:0:21100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b0916a74 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.487021:0:21100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:3.0:1788843467.487025:0:21100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788843467.487031:0:21100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b0916a74 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.487038:0:21100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcefc00/0xc6b8ac1b0916a74 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.487079:0:21100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee200/0xc6b8ac1b09169d3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.487087:0:21100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee200/0xc6b8ac1b09169d3 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.487093:0:21100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee200/0xc6b8ac1b09169d3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.487099:0:21100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcee200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843467.487102:0:21100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee200/0xc6b8ac1b09169d3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.487108:0:21100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee200/0xc6b8ac1b09169d3 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.487116:0:21100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8dab50f54e00) 00010000:00010000:3.0:1788843467.487119:0:21100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788843467.487133:0:21100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b09169da lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084eed expref: 18 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.487147:0:21100:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b09169da lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084eed expref: 18 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.487157:0:21100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b09169da lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084eed expref: 18 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.487228:0:21100:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b09169da lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084eed expref: 18 pid: 18965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843467.487245:0:21100:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:21100:1875737795761792:192.168.203.29@tcp:105: 00000100:00100000:2.0:1788843467.488192:0:21100:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41dda0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843467.493373:0:21100:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:21100:1875737795761792:192.168.203.29@tcp:105: 00010000:00010000:2.0:1788843467.493416:0:21100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee200/0xc6b8ac1b09169d3 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.493428:0:21100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee200/0xc6b8ac1b09169d3 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18966 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.493475:0:21100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b0916a7b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.493493:0:21100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b0916a7b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.493526:0:21100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b0916a7b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.493538:0:21100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b0916a7b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.493545:0:21100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b0916a7b lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.493552:0:21100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b0916a7b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.493558:0:21100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843467.493562:0:21100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b0916a7b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.493570:0:21100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b0916a7b lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.493584:0:21100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8dab50f54e00) 00010000:00010000:2.0:1788843467.493588:0:21100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843467.493593:0:21100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b0916a7b lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.493599:0:21100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b0916a7b lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.493610:0:21100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee800/0xc6b8ac1b0916a6d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.493616:0:21100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee800/0xc6b8ac1b0916a6d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.493628:0:21100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee800/0xc6b8ac1b0916a6d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.493634:0:21100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcee800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843467.493636:0:21100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee800/0xc6b8ac1b0916a6d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.493643:0:21100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee800/0xc6b8ac1b0916a6d lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.493651:0:21100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8dab50f54e00) 00010000:00010000:2.0:1788843467.493653:0:21100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788843467.493655:0:21100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee800/0xc6b8ac1b0916a6d lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.493661:0:21100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab6fcee800/0xc6b8ac1b0916a6d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21100 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843467.494097:0:21100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f626edf3-537d-4eb9-9825-d3d39a257fe8+18:17439:x1875737775856640:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 27920us (28141us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1788843467.494109:0:21100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 53 00000020:00080000:2.0:1788843467.494117:0:21100:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788843467.494248:0:18997:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788843467.494258:0:18997:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788843467.494324:0:18997:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788843467.494332:0:18997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788843467.498319:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843467.498414:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843467.498450:0:18969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775856896 00000100:00100000:3.0:1788843467.498468:0:18969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775856896 00000100:00100000:3.0:1788843467.498535:0:18969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775857152 00000100:00100000:3.0:1788843467.498539:0:18969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775857152 00000100:00100000:3.0:1788843467.498559:0:18969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:3.0:1788843467.498570:0:18969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7394d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+19:17438:x1875737775856896:12345-192.168.203.29@tcp:49:dd.0 00000100:00100000:3.0:1788843467.498757:0:18969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7394d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+19:17438:x1875737775856896:12345-192.168.203.29@tcp:49:dd.0 Request processed in 188us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843467.498766:0:18969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:3.0:1788843467.498817:0:18969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:3.0:1788843467.498824:0:18969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+18:17439:x1875737775857152:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788843467.499827:0:18969:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788843467.499965:0:18969:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:2.0:1788843467.500024:0:18969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0916a82 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.500047:0:18969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0916a82 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 18969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.500074:0:18969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0916a82 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.500084:0:18969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0916a82 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.500091:0:18969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0916a82 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.500098:0:18969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0916a82 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.500129:0:18969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788843467.500253:0:18969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+20:17439:x1875737775857152:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 1425us (1836us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1788843467.500263:0:18969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000020:00080000:2.0:1788843467.500269:0:18969:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788843467.500386:0:20134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843467.500402:0:20134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0916a82 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.500414:0:20134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843467.500419:0:20134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0916a82 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.500430:0:20134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0916a82 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 18969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.500448:0:20134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:1.0:1788843467.500451:0:20134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788843467.500456:0:20134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0916a82 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.500483:0:20134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0916a82 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.500501:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843467.500503:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843467.500505:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843467.517985:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843467.518251:0:19656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775857280 00000100:00100000:0.0:1788843467.518265:0:19656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775857280 00000100:00100000:0.0:1788843467.518418:0:19656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:0.0:1788843467.518432:0:19656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+8:2358:x1875737775857280:12345-192.168.203.29@tcp:4:dd.0 00010000:00010000:0.0:1788843467.518483:0:19656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004127a755/0xc6b8ac1b0916a89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.518513:0:19656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000810bdb76/0xc6b8ac1b0916a58 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084f17 expref: 8 pid: 20132 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.518553:0:19656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843467.518558:0:19656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843467.518563:0:19656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004127a755/0xc6b8ac1b0916a89 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.518610:0:19656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000810bdb76/0xc6b8ac1b0916a58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084f17 expref: 8 pid: 20132 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.518628:0:19656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000810bdb76/0xc6b8ac1b0916a58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084f17 expref: 8 pid: 20132 timeout: 691 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843467.518649:0:19656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc1c000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:19656:1875737795761920:192.168.203.29@tcp:104: 00000100:00100000:0.0:1788843467.518830:0:19656:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab60061d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788843467.523829:0:19656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc1c000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:19656:1875737795761920:192.168.203.29@tcp:104: 00010000:00010000:0.0:1788843467.523881:0:19656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004127a755/0xc6b8ac1b0916a89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843467.527534:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843467.527609:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843467.527656:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843467.527814:0:19657:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788843467.527828:0:19657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788843467.527965:0:19658:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788843467.527984:0:19658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775857536 00000100:00100000:3.0:1788843467.527996:0:19658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775857536 00000100:00100000:3.0:1788843467.528064:0:19658:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788843467.528068:0:19658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775857664 00000100:00100000:3.0:1788843467.528070:0:19658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775857664 00000100:00100000:2.0:1788843467.528400:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775857408 00000100:00100000:2.0:1788843467.528405:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775857408 00010000:00010000:2.0:1788843467.528440:0:18951:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000810bdb76/0xc6b8ac1b0916a58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084f17 expref: 11 pid: 20132 timeout: 691 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843467.528480:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:2.0:1788843467.528491:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+11:2359:x1875737775857408:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843467.528509:0:18951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843467.528540:0:18951:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000810bdb76/0xc6b8ac1b0916a58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084f17 expref: 11 pid: 20132 timeout: 691 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.528571:0:18951:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000810bdb76/0xc6b8ac1b0916a58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084f17 expref: 11 pid: 20132 timeout: 691 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.528602:0:18951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000810bdb76/0xc6b8ac1b0916a58 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084f17 expref: 11 pid: 20132 timeout: 691 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.528623:0:18951:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843467.528628:0:18951:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843467.528646:0:18951:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004127a755/0xc6b8ac1b0916a89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.528658:0:18951:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004127a755/0xc6b8ac1b0916a89 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.528687:0:18951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843467.528761:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f626edf3-537d-4eb9-9825-d3d39a257fe8+10:2359:x1875737775857408:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 272us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843467.528770:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00010000:00010000:0.0:1788843467.529574:0:19656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004127a755/0xc6b8ac1b0916a89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.529591:0:19656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004127a755/0xc6b8ac1b0916a89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843467.531173:0:21102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:2.0:1788843467.531191:0:21102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab44be3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f626edf3-537d-4eb9-9825-d3d39a257fe8+10:2359:x1875737775857536:12345-192.168.203.29@tcp:4:dd.0 00010000:00010000:2.0:1788843467.531237:0:21102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000995e7300/0xc6b8ac1b0916a90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.531255:0:21102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843467.531259:0:21102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843467.531272:0:21102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000995e7300/0xc6b8ac1b0916a90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.531299:0:21102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000995e7300/0xc6b8ac1b0916a90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843467.534570:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843467.534662:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843467.535273:0:19658:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788843467.535296:0:19658:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1788843467.535547:0:19657:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788843467.535560:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775857920 00000100:00100000:2.0:1788843467.535571:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775857920 00000100:00100000:2.0:1788843467.535635:0:19657:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788843467.535640:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775857792 00000100:00100000:2.0:1788843467.535643:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775857792 00000100:00100000:2.0:1788843467.538154:0:21103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:2.0:1788843467.538178:0:21103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab44be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f626edf3-537d-4eb9-9825-d3d39a257fe8+13:2358:x1875737775857664:12345-192.168.203.29@tcp:4:dd.0 00010000:00010000:2.0:1788843467.538236:0:21103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c6ded8d/0xc6b8ac1b0916a97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.538258:0:21103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843467.538262:0:21103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843467.538271:0:21103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c6ded8d/0xc6b8ac1b0916a97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.538298:0:21103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c6ded8d/0xc6b8ac1b0916a97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843467.555656:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843467.555702:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843467.555717:0:19657:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1788843467.555734:0:19657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1788843467.555786:0:19658:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1788843467.555799:0:19658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775858176 00000100:00100000:1.0:1788843467.555812:0:19658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775858176 00000100:00100000:1.0:1788843467.555960:0:19658:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1788843467.555967:0:19658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775858304 00000100:00100000:1.0:1788843467.555970:0:19658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775858304 00000100:00100000:1.0:1788843467.558033:0:21104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:1.0:1788843467.558058:0:21104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f626edf3-537d-4eb9-9825-d3d39a257fe8+16:2359:x1875737775857920:12345-192.168.203.29@tcp:4:dd.0 00010000:00010000:1.0:1788843467.558118:0:21104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000251456e3/0xc6b8ac1b0916a9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.558142:0:21104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843467.558148:0:21104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843467.558157:0:21104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000251456e3/0xc6b8ac1b0916a9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.558174:0:21104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000251456e3/0xc6b8ac1b0916a9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843467.570540:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843467.570659:0:19658:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:1.0:1788843467.570673:0:19658:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_006' 00000100:00100000:1.0:1788843467.571163:0:19658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775858048 00000100:00100000:1.0:1788843467.571176:0:19658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775858048 00000100:00100000:1.0:1788843467.583430:0:21105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:1.0:1788843467.583528:0:21105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f626edf3-537d-4eb9-9825-d3d39a257fe8+18:2359:x1875737775857792:12345-192.168.203.29@tcp:4:dd.0 00010000:00010000:1.0:1788843467.583568:0:21105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee79720/0xc6b8ac1b0916aa5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.583589:0:21105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843467.583594:0:21105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843467.583601:0:21105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dee79720/0xc6b8ac1b0916aa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843467.583616:0:21105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dee79720/0xc6b8ac1b0916aa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788843467.670616:0:19656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 5242880 00002000:00010000:2.0:1788843467.670629:0:19656:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 1788843466 -> 1788843467 00002000:00010000:2.0:1788843467.670632:0:19656:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788843466 -> 1788843467 00002000:00010000:2.0:1788843467.670655:0:19656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1788843467.670675:0:19656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004127a755/0xc6b8ac1b0916a89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.670748:0:19656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004127a755/0xc6b8ac1b0916a89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.670761:0:19656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004127a755/0xc6b8ac1b0916a89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.670769:0:19656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42696a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843467.670775:0:19656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004127a755/0xc6b8ac1b0916a89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.670785:0:19656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004127a755/0xc6b8ac1b0916a89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.670816:0:19656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004127a755/0xc6b8ac1b0916a89 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.670825:0:19656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004127a755/0xc6b8ac1b0916a89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843467.670941:0:19656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+28:2358:x1875737775857280:12345-192.168.203.29@tcp:4:dd.0 Request processed in 152506us (152963us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1788843467.670953:0:19656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:2.0:1788843467.670995:0:19656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:2.0:1788843467.671008:0:19656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+27:2358:x1875737775858176:12345-192.168.203.29@tcp:4:dd.0 00010000:00010000:2.0:1788843467.671057:0:19656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0916aac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.671071:0:19656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843467.671077:0:19656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843467.671084:0:19656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0916aac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.671098:0:19656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0916aac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788843467.671241:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00000001:00080000:2.0:1788843467.671261:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901893 is committed 00002000:00010000:0.0:1788843467.775275:0:21104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:0.0:1788843467.775300:0:21104:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 2051 -> 10247 00010000:00010000:0.0:1788843467.775320:0:21104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000251456e3/0xc6b8ac1b0916a9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.775337:0:21104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000251456e3/0xc6b8ac1b0916a9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.775373:0:21104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000251456e3/0xc6b8ac1b0916a9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.775382:0:21104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fcef800 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843467.775387:0:21104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000251456e3/0xc6b8ac1b0916a9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.775398:0:21104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000251456e3/0xc6b8ac1b0916a9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.775430:0:21104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000251456e3/0xc6b8ac1b0916a9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.775464:0:21104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000251456e3/0xc6b8ac1b0916a9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843467.775587:0:21104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f626edf3-537d-4eb9-9825-d3d39a257fe8+25:2359:x1875737775857920:12345-192.168.203.29@tcp:4:dd.0 Request processed in 217532us (241025us total) trans 12884901898 rc 0/0 00000100:00100000:0.0:1788843467.775599:0:21104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:0.0:1788843467.775649:0:21104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:0.0:1788843467.775664:0:21104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f626edf3-537d-4eb9-9825-d3d39a257fe8+24:2358:x1875737775858304:12345-192.168.203.29@tcp:4:dd.0 00010000:00010000:2.0:1788843467.775828:0:21102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000995e7300/0xc6b8ac1b0916a90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.775839:0:21102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000995e7300/0xc6b8ac1b0916a90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.775848:0:21102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000995e7300/0xc6b8ac1b0916a90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.775854:0:21102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843467.775857:0:21102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000995e7300/0xc6b8ac1b0916a90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.775864:0:21102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000995e7300/0xc6b8ac1b0916a90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.775885:0:21102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000995e7300/0xc6b8ac1b0916a90 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.775893:0:21102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000995e7300/0xc6b8ac1b0916a90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843467.775938:0:21102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab44be3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f626edf3-537d-4eb9-9825-d3d39a257fe8+23:2359:x1875737775857536:12345-192.168.203.29@tcp:4:dd.0 Request processed in 244752us (248328us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788843467.775945:0:21102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:2.0:1788843467.775965:0:21102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1788843467.775973:0:21102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f626edf3-537d-4eb9-9825-d3d39a257fe8+22:2359:x1875737775858048:12345-192.168.203.29@tcp:4:dd.0 00010000:00010000:2.0:1788843467.775998:0:21102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e17c7ac8/0xc6b8ac1b0916ab3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.776013:0:21102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788843467.776019:0:21102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843467.776026:0:21102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e17c7ac8/0xc6b8ac1b0916ab3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.776039:0:21102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e17c7ac8/0xc6b8ac1b0916ab3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788843467.776189:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901898 is committed 00010000:00010000:3.0:1788843467.776328:0:21103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c6ded8d/0xc6b8ac1b0916a97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.776338:0:21103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c6ded8d/0xc6b8ac1b0916a97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.776385:0:21103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c6ded8d/0xc6b8ac1b0916a97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.776392:0:21103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375800 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843467.776396:0:21103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c6ded8d/0xc6b8ac1b0916a97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.776404:0:21103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c6ded8d/0xc6b8ac1b0916a97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.776418:0:21103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c6ded8d/0xc6b8ac1b0916a97 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.776426:0:21103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c6ded8d/0xc6b8ac1b0916a97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843467.776480:0:21103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab44be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f626edf3-537d-4eb9-9825-d3d39a257fe8+14:2358:x1875737775857664:12345-192.168.203.29@tcp:4:dd.0 Request processed in 238310us (248821us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1788843467.776488:0:21103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 2 00010000:00010000:2.0:1788843467.776620:0:21105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee79720/0xc6b8ac1b0916aa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.776640:0:21105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dee79720/0xc6b8ac1b0916aa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.776647:0:21105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dee79720/0xc6b8ac1b0916aa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.776654:0:21105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab6fceee00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843467.776657:0:21105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee79720/0xc6b8ac1b0916aa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.776665:0:21105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee79720/0xc6b8ac1b0916aa5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.776675:0:21105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dee79720/0xc6b8ac1b0916aa5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843467.776682:0:21105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dee79720/0xc6b8ac1b0916aa5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843467.776729:0:21105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f626edf3-537d-4eb9-9825-d3d39a257fe8+12:2359:x1875737775857792:12345-192.168.203.29@tcp:4:dd.0 Request processed in 193211us (242067us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1788843467.776737:0:21105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00010000:00010000:0.0:1788843467.777249:0:21104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000810bdb76/0xc6b8ac1b0916aba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.777261:0:21104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843467.777265:0:21104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843467.777270:0:21104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000810bdb76/0xc6b8ac1b0916aba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.777293:0:21104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000810bdb76/0xc6b8ac1b0916aba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843467.903070:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901899 is committed 00002000:00010000:3.0:1788843467.903221:0:19656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1788843467.903227:0:19656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:3.0:1788843467.903246:0:19656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0916aac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.903262:0:19656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0916aac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.903273:0:19656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0916aac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.903290:0:19656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843467.903295:0:19656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0916aac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.903306:0:19656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0916aac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.903331:0:19656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0916aac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.903408:0:19656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0916aac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843467.903591:0:19656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f626edf3-537d-4eb9-9825-d3d39a257fe8+13:2358:x1875737775858176:12345-192.168.203.29@tcp:4:dd.0 Request processed in 232581us (347939us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1788843467.903603:0:19656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000001:00080000:0.0:1788843467.974556:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901901 is committed 00002000:00010000:0.0:1788843467.975064:0:21104:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:0.0:1788843467.975087:0:21104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000810bdb76/0xc6b8ac1b0916aba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.975122:0:21104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000810bdb76/0xc6b8ac1b0916aba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.975132:0:21104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000810bdb76/0xc6b8ac1b0916aba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.975140:0:21104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42697000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843467.975146:0:21104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000810bdb76/0xc6b8ac1b0916aba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.975156:0:21104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000810bdb76/0xc6b8ac1b0916aba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.975182:0:21104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000810bdb76/0xc6b8ac1b0916aba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843467.975190:0:21104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000810bdb76/0xc6b8ac1b0916aba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843467.975577:0:21104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f626edf3-537d-4eb9-9825-d3d39a257fe8+7:2358:x1875737775858304:12345-192.168.203.29@tcp:4:dd.0 Request processed in 199910us (419868us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1788843467.975590:0:21104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00010000:00010000:3.0:1788843467.976788:0:21102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e17c7ac8/0xc6b8ac1b0916ab3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.976819:0:21102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e17c7ac8/0xc6b8ac1b0916ab3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.976829:0:21102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e17c7ac8/0xc6b8ac1b0916ab3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.976836:0:21102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843467.976842:0:21102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e17c7ac8/0xc6b8ac1b0916ab3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.976970:0:21102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e17c7ac8/0xc6b8ac1b0916ab3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.976992:0:21102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e17c7ac8/0xc6b8ac1b0916ab3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843467.977000:0:21102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e17c7ac8/0xc6b8ac1b0916ab3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843467.977161:0:21102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f626edf3-537d-4eb9-9825-d3d39a257fe8+5:2359:x1875737775858048:12345-192.168.203.29@tcp:4:dd.0 Request processed in 201183us (406631us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1788843467.977173:0:21102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00010000:00010000:3.0:1788843468.039203:0:18954:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843469.061806:0:18953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843469.127861:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6eb2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795762048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843469.127960:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843469.128517:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795762048 00000100:00100000:2.0:1788843469.128529:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795762048 00000100:00100000:2.0:1788843469.128600:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788843469.128626:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795762048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788843469.128672:0:19654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3843031040 avail 3840933888 00000100:00100000:2.0:1788843469.128746:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795762048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843469.128754:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788843469.128819:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843469.128888:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901893 gen 2 00000004:00080000:3.0:1788843469.128895:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dab73a7b100, transno 12884901891 00000004:00080000:3.0:1788843469.128912:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901893 committed transno 12884901893 00000100:00100000:3.0:1788843469.128944:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6eb2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795762048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843469.637070:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795762176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843469.637186:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843469.637314:0:20349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795762176 00000100:00100000:1.0:1788843469.637323:0:20349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795762176 00000100:00100000:1.0:1788843469.637427:0:20349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788843469.637447:0:20349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab44be0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795762176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843469.637495:0:20349:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788843469.638066:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788843469.638169:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795762432:0@lo:400:kworker.0 00000100:00100000:1.0:1788843469.638225:0:20349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab44be0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795762176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 780us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843469.638250:0:20349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788843469.638299:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42c24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795762688:0@lo:400:kworker.0 00000100:00100000:3.0:1788843469.639401:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:345dfd18-3e4c-44c0-bf46-62bd805326d9:3304:1875737795762304:0@lo:400:kworker.0 00000100:00100000:0.0:1788843469.641454:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843469.641741:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843469.641823:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795762176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843469.641853:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843469.641865:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795762560:0@lo:400:kworker.0 00000100:00100000:1.0:1788843469.641906:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843469.642161:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795762432 00000100:00100000:1.0:1788843469.642170:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795762432 00000100:00100000:1.0:1788843469.642227:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795762688 00000100:00100000:1.0:1788843469.642230:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795762688 00000100:00100000:1.0:1788843469.642254:0:18967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795762560 00000100:00100000:1.0:1788843469.642257:0:18967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795762560 00000100:00100000:1.0:1788843469.642289:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788843469.642298:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795762432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843469.642382:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795762432:12345-0@lo:400:kworker.0 Request processed in 84us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843469.642390:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788843469.642411:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788843469.642417:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab44be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795762688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843469.642449:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab44be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795762688:12345-0@lo:400:kworker.0 Request processed in 32us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843469.642456:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788843469.642469:0:18967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788843469.642476:0:18967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab44be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795762560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843469.642530:0:18967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab44be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795762560:12345-0@lo:400:kworker.0 Request processed in 55us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843469.642536:0:18967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788843469.643172:0:18961:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843469.643223:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795762432:0@lo:400:kworker.0 00000100:00100000:1.0:1788843469.643421:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795762560:0@lo:400:kworker.0 00000100:00100000:1.0:1788843469.643435:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42c24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795762688:0@lo:400:kworker.0 00000100:00100000:3.0:1788843469.644380:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843469.644780:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795762304 00000100:00100000:1.0:1788843469.644792:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795762304 00000100:00100000:1.0:1788843469.644862:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788843469.644873:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:3304:x1875737795762304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843469.644964:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:345dfd18-3e4c-44c0-bf46-62bd805326d9+19:3304:x1875737795762304:12345-0@lo:400:kworker.0 Request processed in 92us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843469.644971:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788843469.645764:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:345dfd18-3e4c-44c0-bf46-62bd805326d9:3304:1875737795762304:0@lo:400:kworker.0 00000001:02000400:1.0:1788843469.956137:0:21143:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788843470.092080:0:20135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843471.109504:0:20134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 9623 lines, 9623 kept, 0 dropped, 0 bad.